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ABSTRAC T 


Tht  theoi  v  nf  signal  detectability  is  extended  to  include  optimum  adaptive  receiver 
(lesions  f  i  tin1  detection  o!  signals  with  .1  n<  nperiodic  time  structure.  The  specific 
problem  considered  '.1  that  of  detecting  .1  recui  rence  pin  nomenon  in  noise.  I’his 
phenomi  non  is  .1  fixed  w.iveit  nn  that  recurs  in  time.  The  fixed  waveform  is  selected  from 
.1  limit  class  of  possible  waveforms,  and  the  receiver  is  initially  uncertain  as  to  the 
waveful  m  selection.  Three  basic  recurrence  patterns  are  considered:  (1)  Sporadic  - 
Poisson.  (2)  Synchronous  -  Poisson,  and  (3)  Periodic.  For  (11  and  (21,  the  recurrence 
time  is  a  random  variable.  The  approach  tc  the  detection  problem  is  Bayesian  and  the 
initial  uncertainties  of  the  fixed  waveform  and  ecurrence  times  a'c  expressed  in  terms 
of  a  prion  probabilities.  For  the  Sporadic-  and  Synchronous  Poisson  cases,  the 
recurrence  time  is  always  uncertain,  but  .111  adaptive  receiver  can  learn  the  fixed 
waveform. 

Several  realisations  of  the  optimum  receiver  are  presented  for  each  of  the  three 
basic  recurrence  time  patterns.  The  receiver*  are  designed  by  solving  an  over-all 
optimization  problem  in  which  the  likelihood  ratio  of  the  entire  mp’  observation  is 
formed.  A  difficulty  in  the  design  of  the  optimum  receiver  for  signals  with  a  nonperiodic 
time  structure  is  the  exponentially  growing  memory  required  by  the  classical  non¬ 
sequential  realization.  To  obtain  a  receiver  design  with  a  practical  memory  size,  a 
basic  technique  is  presented  in  which  the  stgna!  ensemble  is  described  indirectly  in 
terms  of  the  fixed  waveform  and  (tie  time  structure  by  which  these  waveforms  are 
assembled.  The  receiver  design  is  obtained  by  realizing  the  likelihood  ratio  in  a 
sequential  manner  rather  than  by  postulating  a  sequential  learning  model  pe r  se. 

Therefore,  the  use  and  proper  updating  of  the  contents  of  the  temporary  receiver 
memory  are  specified  by  the  design  procedure. 

Although  equivalent  for  detection  purposes,  different  realizations  of  the  same 
optimum  receiver  appear  to  operate  in  different  manners.  Receiver  designs  are 

xvii 


presented  in  winch  tin  receiver  appears  In  learn''  the  fixed  waveform  which  hemp 
transmitted.  Such  a  receiver  was  simulated  for  a  special  but  useful  case  to  illustrate 
its  operation.  Other  receiver  designs  are  presented  which,  although  optimum,  do  not 
incorporate  this  learning  feature  in  an  obvious  manner  The  important  feature  of  tin 
uriaptm  realizations  is  their  fixed-si/i  memoi  \  i  rquiremeiit  and  a  vuilalulitv  ol  a 
classification  output. 

Tin  effect  on  detect. ilnlitv  ol  the  uneerta  i  lit  \  m  arrival  times  of  the  fixed  wave¬ 
form  is  investigated  I  lie  iletei  ticn  p>  rformanee  lor  the  cast  ol  a  lived  \v  .elorm,  known 

exaetlv,  that  recurs  with  a  Svnchrotious  Poisson  Time  St  ructure  is  presented  u  terms 

2  f 

of  the  receiver  operating  char.K  tenslic  (HOC)  as  a  function  of  averape  dutv  (actor.  -  , 

(  I 

and  time.  K  is  the  enerpv  m  tin  lived  wavifnrm  and  N  is  the  noise  power  per  unit 
bandwidtl.  This  is  a  useful  case  since  it.,  performance  is  an  upper  bound  on  the  attain¬ 
able  perfoi  malice  when  the  fixed  wan  form  is  uncertain  or  recurs  with  the  Sporadic 
Poisson  Time  Structure  Till  performance  results  show  that  evi  n  when  the  fixed  wave  ¬ 
form  is  known  exactly,  the  uncertain  arrival  times  can  have  a  substantial  effect  on 
deti  ctnbilitv . 

The  importance  of  stortnp  and  updating  likelihood  ratio  terms  in  the  tempura  r\ 

memorv  was  investigated  In  c  unparinp  the  performance  of  the  optimum  n  reiver  with  one 

that  simplv  recirculates  the  input  waveshape.  It  was  found  that  storinp  and  updating 

likelihood  ratio  terms  rather  than  r<  c  ir.  ulatinp  input  waveshape  becomes  more  important 

2  K 

as  increases  and  the  average  dutv  factor  decreases. 
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INTHODl’CTION 


1  1  N.il  i  n  I  '  he  I  r<  >bjr  m 

Tin  | j i  il >  1  *  m  <>!  r«  c t  j >f i < >i j  of  a  sign  it  buried  in  noise  is  eommor,  to  sonar,  radar, 
and  communication  situations  in  general  In  some  eases,  such  as  arise  in  the  reception  of 
speech,  the  coal  is  that  o|  recovering  the  signal  so  that  its  waveshape  is  as  close  as  possible 
the  original  transmitted  signal.  However,  in  many  applications  the  primary  goal  is  often 
deciding  whether  a  signal  is  present  or  not,  and  there  is  no  particular  need  to  reconstruct 
t  he  '  il' i gi  nn  1  wav  es  hape 

Pi  the  early  1950's  several  authors  formulated  a  theory  of  signal  detectability  in 
which  the  making  n|  the  best  possible  decisions  was  tin  primary  goal  (Refs.  1-3).  Since 
the  muse  is  considered  known  only  in  a  probabilistic  sense  and  since  there  arc  uncertainties 
regarding  the  signal,  one  cannot  decide  with  certainty  whether  or  not  a  Signal  is  present  in  tin 
must  Hie  early  work  in  signal  cietc  ctahi lit s  tliei  ry  reeognt/ed  the  detection  of  signals  in 
noise  as  a  problem  which  could  be  solved  In  the  application  of  statistical  decision  theory. 

Signal  detec  tion  them  y  encompasses  rt  cetver  design  and  performance.  The  branch 
of  signal  detection  theory  that  is  given  primary  emphasis  in  this  study  ,s  the  design  of  re¬ 
run  •  i  s  that  are  optimum  in  the  sense  of  making  the  best  decisions.  In  particular,  rather 
general  techniques  of  designing  optimum  receivers  whuh  operate  in  a  sequential  mode  are 
considered  Such  receivers  frequently  exhibit  adaptive  characteristics 

Moth  the  design  and  performance  of  an  optimum  receiver  depend  upon  the  signal 
uncertainties  and  tin  noise.  The  optimum  receiver  usually  takes  on  its  simplest  form  at 
either  of  the  two  xtremes  of  knowledge  regarding  the  signal;  t.  e.  ,  precise  knowledge  of  the 
signal  on  the  one  hand,  or  a t  tlm  other  extreme,  a  large  amount  of  initial  signal  uncertainty 
m  whi(  h  parameters  of  the  signal  cannot  be  learned  The  performance  of  the  optimum  re¬ 
ceiver  usually  decreases  as  the  amount  of  signal  uncertainty  increases 
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Most  of  tlu>  literature  on  signal  detectability  has  been  concerned  witn  p»  nodtc 
signals  which  may  be,  for  example-,  uncertain  in  amplitude  and  phase.  This  is  understand¬ 
able  since  a  primary  application  of  signal  processing  is  to  active  sonar  and  radar  systems 
where  a  periodic  transmission  is  characteristic  The  knowledge  that  the  signal  is  periodic 
or  nearly  periodic  is  definite  information  that  a  recer.  er  designer  can  ust  to  advantage. 

One  class  of  signals  studied  here  is  a  type  that  is  more  likely  to  be  encountered  in 
.1  passive  situation.  Hi  re,  the  signal  emitted  is  beyond  the  control  ol  the  designer  of  the 
over-all  transmitter-receiver  system  and  is  often  nonperiodic,  A  broad  class  of  such, 
signals  is  one  m  which  a  fixed  but  quite  unknown  waveform  is  emitted  recurrently  in  a  non¬ 
periodic  and  quite  unknown  way.  The  interest  is  in  detecting  the  presence  or  absence  of  (hi 
entire  recurrence  phenomenon  rather  than  making  a  local  detection  of  the  presence  or  absence 
of  an  individual  fixed  waveform.  If  the  signal-to-noise  ratio  were  high,  individual  local 
detections  could  be  made  relatively  easily.  However,  a  cast  of  special  interest  is  wnen  the 
unknown  waveform  has  a  low  signal -to-noise  ratio  and  a  low  duty  factor.  Then,  local  detection 
becomes  difficult  If  one  has  sufficient  time  to  observe  the  receive!  input,  however,  the 
recurrence  ol  the  same  waveform  permits  the  possibility  of  "learning''  or  "adapting  to  the 
waveform  sent.  This  learning  or  adaptation  must  be  done  in  spite  of  the  noise  and  the 
unknown  >poch  of  the  waveform. 

The  general  type  of  signals  considered  are  shown  m  Fig.  1  1  This  sketch  shows 
possible  noise-free  signals  that  might  appear  at  th<  receiver  input.  The  particular  local 
waveform  that  is  sent  m  a  given  signal  burst  is  uncertain  and  is  one  out  of  a  finite  number 
of  local  waveforms.  Although  the  same  local  waveform  is  recurrent  in  each  signal  burst, 
ttie  precise  times  of  recurrence  art  uncertain.  It  can  be  seen  that  a  widi  variety  ol  signal 
bursts  can  result,  the  receiver  must  be  designed  to  delect  any  one  of  them. 

Three  basil  types  of  recurrence-time  processes  are  considered.  They  are 

1.  Sporadic  -  Poisson  process 

2.  Synchronous- Poisson  process 

3.  Periodic  process. 

These,  three  processes  differ  in  that  they  represent  three  degrees  of  knowledge  regarding  the 
manner  of  recurrence  of  a  waveform.  The  Sporadic  -  Poisson  process  involves  the  least 
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Fig.  1.  1.  Four  typical "  bursts  of  signal. 


amount  ot  knowledge  regarding  the  structure  ( >f  the  signal  in  time.  The  Periodic  case, 
representing  the  most  knowledge  regarding  the  time  recurrence,  is  included  in  this  study  for 
comparison  purposes.  Precise  mathematical  formulation  of  the  possible  signals  that  could 
occur  is  post po  led  until  Chapter  IV. 

The  basic  technique  of  designing  adaptive  or  sequential  realizations  of  optimum 
receivers  is  considered  in  this  study  As  we  shall  see,  there  is  no  unique  adaptive  realiza¬ 
tion.  Adaptive  realizations  of  the  optimum  receiver  are  presented,  in  general  block  diagram 
form,  lor  each  of  the  three  basic  recurret '  e-time  structures  discussed  above.  The 
receiver  is  designed  to  be  optimum  in  the  sense  that  it  makes  the  best  decision  as  to  presence 
or  absence  of  the  entire  recurrence  phenomenon.  It  is  provided,  sequentially  in  time,  with 
two  outputs;  a  decision  output  and  a  classification  output.  The  detection  output  provides 
ii  formation  for  deciding  presence  or  absence  of  the  recurrence  phenomenon  and  the  classifi¬ 
cation  output  provides  updated  probabilities  of  the  various  possible  fixed  waveforms  that 
could  occur. 

vVlien  the  recurrence  time  process  is  nonperiodic,  the  design  of  tne  optimum  receiver 
is  complicated  by  receiver  memory  requirements  A  nonsequential  realization  of  the  optimum 
receiver  requires  an  exponentially  growing  memory.  It  will  be  shown  that  this  difficulty  can 
In  eliminated  by  realizing  the  receiver  in  a  sequential  mode. 
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1.2  Background  of  Previous  Work 

Tlu  foundation  of  tins  study  is  t fit’  theory  of  signal  detectability  as  developed  by 
Peterson,  Birdsall  and  Fox  (Ref  1).  Ibis  theory  emphasizes  the  central  role  of  likelihood  ratio 
ill  the  receiver  design.  Related  basic  material  can  also  be  louiul  m  Helstrom  (Pel  5). 

A  number  of  authors  have  applied  "adaptive  techniques  to  the  problem  of  tin  detec¬ 
tion  of  signals  in  noise  (Refs,  10,  1  I.  15,  16,  17,  18).  The  problem  nl  desipmnp  an  adaptivt 
filter  for  a  fixed  waveform  whose  time  of  arrival  is  unknown  has  been  considered  by  (baser 
Ref.  10)  In  this  work  a  statistical  derision  theory  approach  is  used  Local  waveform 
uncertainty  is  expressed  m  te  rms  of  an  a  prion  probability  density  lunctoin  but  recurrence 
time'  uncertainty  is  not  The1  e  poch  is  instead  eiedeeded  on  a  local  basis  and  the1  assumption 
is  made1  that  the  epoch  nieasut  e  memt  u->  accurate  . 

.lakowat/.  Sliue'V  and  White  (Ref  1!)  have  proposed  an  adaptive  filter  lor  detecting 
a  recurrent  fixed  wave'form.  A  simplified!  block  diagram  of  theur  original  adaptive1  filter  is 
shown  m  Fip  1.  2.  The  basic  operations  of  this  filter  as  described  by  , lakowat/  are1: 

(1)  comparison  ol  a  sample  o|  the1  incoming  wave-form,  x(t).  with  an  estimate1,  m(t).  of  the1 
unknown  sipnal,  s(t),by  correlation  ol  x(t)  and  m(t).  (2)  on  the  basis  of  the1  corred.itor  output, 

( t ) .  puess  whe-the-r  or  not  a  sipnal  is  contained  in  tile  curie  lit  sample  of  \(t).  ami  (3)  at 
those  time  s  whim  a  sipnal  is  put  ssed  to  be  present,  Itirm  a  new  estimate  ol  the  sipnal  which 
consists  ol  a  w  e  tphte  el  a  \  erape  ol  that  sample  ol  the  input  with  the  pi  lor  estimate 

Allhouph  basic  puidelines  limn  sipnal  eh  lection  theory  aie  usi’el  in  the  adaptive1 
filter  ol  .lakowat/  et  ai,  the  desipn  approach  is  not  an  optimal  one  as  the-  authe  is  indeed 
re-copm/eei.  Two  cha  racte  rest  ic  features  ate  apparent  in  this  adaptivi  filter  First,  a 
local  detection  is  required  bedore  any  me  »<  1 1  f  unit  i  on  ol  the  mem  uy  is  made  Secomlly.  the 
receiver  memory  is  used!  tee  i  erne  nibei  a  si’iple1  wav  eloi  m.  This  is  uneloubti’dly  an 
inadequate  memory  lor  the  re-reiver  to  be-  optimum  The  ir  adaptive1  (liter  may  be,  however, 
a  practical  re-ci'iver  whe  n  the  local  waveform  sipnal-to-noisi1  lalne  is  larpe  e  nouph  to 
permit  pood  leical  detection.  In  such  case's  the  simple  imple  mentation  ol  a  receive  r  with 
a  si  tple  waveform  memory  may  justify  its  suboptimum  deduction  performance1. 

Several  authors  have  considered  a  local  detection  problem  in  which  a  fixed  local 
wave  form  recirs  m  a  synchronous  manner  (Reds,  15  and  18).  In  the1  local  detection  case1 
the  problem  beceinies  that  of  detect  nip  where  each  of  the1  local  waveform  recurrences  are, 
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Fig.  1.2.  .Jakowatz,  Shuey  and  White  original  adaptive  filter. 

using  all  past  information.  The  approach  us  Bayesian  and  one  of  optimum  receiver  design. 
One  central  problem  us  common,  however,  and  that  us  the  problem  of  implementing  an 
optimum  receiver  which  requires  an  exponentially  growing  memory.  As  Scudder  (Ref.  18) 
points  out,  the  standard  nonsequential  realization  of  the  optimum  receiver  is  very  complex, 
grows  exponentially  with  lime,  and  the  analysis  of  its  performance  us  close  to  impossible 
even  using  present  day  computers.  Marcus  and  Swel  ling  have  recognized  a  similar  problem 
1 1 1  providing  sullicieiit  receiver  memory  in  regard  to  a  multiple-resolution-element  radar 
probb  m  (  Rt  1  12). 

1  3  Method  of  Attack  >1  tin  Problem 

The  Bayesian  viewpoint  is  adhered  to  in  this  work.  That  is,  it  is  assumed  that 
some  knowledge  is  available  to  the  receiver  designer  regarding  the  signals  and  noise  that 
will  be  received.  The  particular  knowledge  available  must  be  expressible  in  terms  of 
probability  distribution  functions. 

Since  the  primary  goal  is  the  making  of  the  best  decision  about  the  presence  or  ab- 
senci  of  tin  entire  recurrence  phenomenon,  rather  than  determining  the  location  of  each 
ret  ur rent  wave  form,  the  problem  us  to  decide  between  the  two  hypotheses;  presence  of 
recurrence  phenomenon  and  noise  or  noise  alone.  If  one  prefers  correct  decisions  to  mis- 
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takes,  Birdsall  (Hef.  9)  has  shown  that  the  optimum  receiver  is  one  which  realizes  the  like¬ 
lihood  ratio  of  the  observation  and  tins  fact  does  not  depend  on  any  specific  quantity  to  be 
maximized  or  minimized. 

Likelihood  ratio  plays  a  central  role  in  the  design  of  adaptive  receiver  realizations 
as  it  did  in  the  design  of  optimum  receivers  in  classical  detection  theory  The  adaptive 
receiver  realization  is  obtained  by  forming  the  likelihood  ratio  ol  the  observation  which  is 
optimum  for  deciding  the  presence  or  absence  ol  the  entire  recurrence  phenomenon  and  then 
realizing  this  likelihood  ratio  in  a  sequential  mannet.  It  is  interesting  that  receive  rs 
designed  on  tile  basis  of  sequentially  realizing  the  optimum  receiver  often  exhibit  "adaptive" 
characteristics.  The  adaptive  feature  is,  howevei,  a  result  of  the  particular  form  of  the 
realization  chosen.  This  approach  to  tin  problem  is  in  contrast  to  ones  in  which  a  block 
diagram  of  a  receive  r  is  chosen  by  analogy  to  a  biological  adaptation  mechanism,  or  by 
extension  of  ede'Ct  reelin'  techniques  u.si-d  in  tracking  devices 

1  -1  Organization  of  Material 

Chapters  I  and  1!  provide  bacKgreeund  material  for  this  work.  Chapter  II  is  a  revie'w 
of  the1  basic  signal  detection  theory  that  is  ri'le'vant  to  the'  problem  conside-red  here.  This  ch.ipte- 
introduces  the  problem  and  expresses  the  in  p  'rtance-  of  approaching  optimum  receiver 
design  v:a  likelihood  ratio  In  Chapter  III  the  e'Xtension  of  the  fixed  time'  theory  to  a  time 
varying  situation  is  pre  sented  as  wedl  as  methods  of  realizing  tile'  optimum  re'Ceiver  '  ith  an 
adaptive  form  The-  inherent  lole  th.it  the1  classification  proble  m  plavs  in  the  optimum 
detection  is  also  pointed  out  In  Chapter  IV  the-  particular  types  of  transmitted  signals 
consideri'd  are  described  in  de  tail  ami  defined.  In  Chapter  V  flu  optimum  adaptive'  re*ce'ivei 
de'sign  is  de'Velope-d  in  detail.  Tour  realizations  are  pri'sente-d  for  each  of  the'  threw  basic 
type's  of  time'  une'i' rta I nt y .  This  demonstrates  the-  nece  ssity  of  the  adaptive  receiver  design 
loi  the  sporadic  and  synchn  nous  case  s  elue-  to  practical  ,noi  y  require'ine-nts.  This  is 
contrasted  with  the  periodic  case'  vvhe're*  no  sue'h  memiory  problem)  e*xists  Chapte  r  VI 
presemts  some  special  but  inte>restiiig  case’s  of  the  rere'i ve*rs  of  Chapte  r  V 

In  Chapte  r  VII  the  defection  pe'rformance'  of  the'  optimum  adaptive  receiver  is 
pre'Sented  in  te  ;  ms  of  the  HOC  (receiver  operating  characteristic)  for  some  specific  cases, 
primarily  for  the'  Synchronous -Poisson  time  unce  rtainty  Also  included  in  this  chapter  are 


Mnnu  Carlo  runs  which  demonstrate  the  adaptive"  features  of  the  adaptive  realization 


In  ChapU  r  VIII  conclusions  to  this  work  are  presented 


I 


CMAPTFR  II 

KKVTKW  OF  BASIC  SIGNAL.  OFTFCTION  THF  OH  V 

2_.  1  Classical  Signal  Detection  1  i  n  r  y 

Since  the  basis  i>{  optimum  receiver  design  is  the  work  of  Peterson,  Birdsall,  and 
Fox  (Ref.  1),  it  is  appropriate  that  it  be  reviewed.  This  theory  is  now  called  classic.il, 
lixed-time  detection  theory.  It  applies  to  situations  where  the  receiver  input  is  observed 
over  a  lixed  interval  of  time  and  a  decision  is  then  made  concerning  the  prcsi • ce  or  absence 
of  signal  during  that  interval.  A  block  diagram  is  shown  in  Fig.  2.  1  The  transmitted  signal 
and  added  noise  or  noise  alone  is  presented  to  the  receivi  r  input.  The  question  is  whithei 
the  switch  is  open  or  closed  Classical  detection  theory  encompasses  optimum  receive'- 
design,  receiver  realization,  and  evaluation  of  receiver  pt  rformam  e 


N  use 


Tig.  2.  1,  Basic  detection  problem. 

Optimum  receiver  design  is  approached  from  a  decision  theory  viewpoint  When 

the  input  waveform  to  the  receiver  is  bandlimitcd,  it  can  be  characterized  by  sample  values 

(Ref  1).  Typically,  there  are  2WT  independent  observation  samples,  (x  ,.\  .  ,  \„u  ...). 

1  Z  Z  V\  I 

if  W  is  the  bandwidth  over  which  the  observations  are  defined  and  7  is  the  total  length  of 
observation.  The  total  observation,  (.Xj.x^,  ’  X2WT^'  US  t'1  he  made  on  either 

noise  alone  or  signal  plus  noise  At  the  end  of  the  observation  interval,  a  ingle  terminal 
decision  is  made  by  a  device  which  can  make  two  alternative  decisions,  conclude  that 
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signal  was  present  during  that  entire  onservation  interval  or  conclude  that  signal  was  not 
present  during  the  entire  observation  interval.  The  time  sequence  in  which  observations 
and  decisions  are  made  m  tin  fixed  time  theory  are  represented  in  Tip.  2.  2,  When  t he¬ 
at  t  ua  1  cause  is  signal  plus  noise,  the  decisions  correspond  to  a  detect  ion  and  a  miss, 
respectively.  Similarly,  when  tin  actual  cause  is  noise,  there  are  a  corresponding  correct 
and  incorrect  decision.  There  are,  therefore,  two  correct  and  two  incorrect  responses. 

There  are  values  and  cos's  associated  with  these  four  possible  responses,  and  the  theory 
prescribes  the  optimum  receiver  which  makes  the  balance  between  correct  and  incorrect 
responses  which  optimizes  some  function  of  these  values  and  costs. 

\(t)  start  observation 

^  r°^\r 

O 

Fig.  2.  2.  Observation-decision  scheme  for  fixed  time  theory. 

The  cost  of  making  an  observation  is  not  considered  in  this  theory.  As  a  result  no 
premium  is  attached  to  making  decisions  rapidly.  The  theory  of  sequential  analysis  (Ref.  7), 
or  deterred  decision  theory  (Ref  H)  considers  such  a  cost  of  observatu  n.  In  the  classical 
thiorv,  the  optimum  receiver  is  one  which  calculates  the  likelihood  ratio  of  the  input  observa¬ 
tion.  A  decision  level  or  threshold  is  then  put  on  the  likelihood  ratio.  When  the  likelihood 
ratio  exceeds  this  threshold  the  response  is  "signal  present"  and  when  it  falls  below  this 
threshold  the  response  is  "noise  alone  The  receiver  design  is  still  that  of  a  likelihood 
ratio  processor  in  deferred  decision  theory,  but  the  simple  output  threshold  is  replaced 
with  a  time-varying  comparison  function. 

Receiver  realization  is  specification  of  equipment,  in  block  diagram  form,  that 
realizes  the  likelihood  ratio.  In  general  there  is  no  unique  way  of  specifying  a  block  diagram 
which  realizes  a  mathematical  equation  However,  one  realization  may  have  an  advantage 
over  another  in  terms  of  equipment  complexity  or  cost.  There  is  no  procedure  at  present 


stop  observation 
make  terminal  decision 


time 
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for  selecting  a  best "  receiver  realization.  Such  a  theory  would  need  to  incorporate  an 
equipment  cost  perhaps  best  characterized  by  memory  cost 

An  important  aspect  of  detection  problems  is  evaluation  of  detection  performance. 

It  is  often  useful  to  evaluate  the  performance  of  suboptimum  as  well  as  optimum  receivers 
The  evaluation  of  optimum  receivers  puts  an  upper  bound  on  attainable  perlormance.  Kvalu- 
a'ion  ol  suboptimum  receivers  may  reveal  a  receiver  whose  performance  justifies  its 
simpler  lorm.  In  the  fixed  time  theory,  the  <  rror  performance  for  .ill  possibli  likelihood 
ratio  thresholds  is  the  complete  evaluation,  and  this  is  summarized  by  the  receive!'  operating 
characteristic  (HOC).  This  is  a  plot  of  probability  ol  correct  detection  versus  the  probability 
of  false  alarm. 

Analytical  evaluation  of  receivers  Irequentlv  becomes  a  difficult  task.  An  alternative 
te  hmque  is  an  experimental  approach  such  as  simulation  on  a  computer  (Hef.  22),  In  the 
present  study,  a  digital  computer  simulation  of  several  receivers  was  employed  (See 
Chapter  \  II). 

2,  2 _ Opt l mumness  of  Likelihood  Ratio 

In  the  formulation  of  the  detection  problem  one  considers  the  input  to  the  receiver 
as  bemp  due  to  either  ol  one  ol  two  causes,  i.  c.  ,  noise  alone  or  a  mixture  of  signal  and  noise 
One  of  the  primary  conclusions  that  has  resulted  from  the  fixed  obst  i  vat'.on  theory  is  that 
the  optimum  receiver  is  one  which  realizes  the  likelihood  ratio.  In  (act,  it  has  been  proved 
that  the  opti mumness  ol  likelihood  ratio  does  not  depend  on  any  specific  quantity  to  be 
maximized  or  minimized,  but  only  on  the  condition  that  one  prefers  correct  dec  is  ions  to 
mistakes  (Ref  9).  This  is  a  powerful  result  which  pives  perspective  to  any  investigation  of 
new  processing  techniques  since  the  like  lihood  iatio  receiver  puts  an  upper  bound  on  attain¬ 
able  perfoi  mance.  Although  the  optimumness  of  likelihood  ratio  is  not  restricted  to  additive 
noise,  mos'  of  the  examples  in  this  study  will  assume  addl'd  white  Gaussian  noise. 

The  likelihood  ratio  for  the  fixed  observation  time  detection  problem,  when  the 
signal  is  known  exactly,  is  piven  by 


f  ( x  j ,  x  2 

f(xl,x2 . X2WT  s) 


W*’SN) 


r< x  1  •  x  2 ,  ,x2Wt'N) 


(2.  1) 


when  f(.\j ,  x  .  .  ,  xovv'l  s •  ^ )  *s  !,H'  probability  density  function  of  the  joint  observation 

(\j.  x9,  .  -  x,^..,.)  under  the  •  audition  (tie  signal  is  known  exactly  and  signal  |)lus  noise  is 

present  and  IfXj  x  ,  •  X2WT  !  ls  density  function  ol  tne  joint  observation 

(Vj,x,.,  ■  X2\VT^  undi'1  !d(‘  condition  noire  alone  is  present  The  entire  signal  vector, 

(Sj,s,r  ,  s,,^. is  denoted  by  s  As  an  example,  in  the  classic  cast  of  a  signal  known 

exactly  in  added  wh:tt  Gaussian  noise  one  may  work  wit!,  the  logarithm  of  the  likelihood  ratio 
(also  optimum  since  it  is  a  monot  me  function  of  the  likelihood  ratio)  yielding  the  famih  :r 
c rosscorrelator  as  t •  x  optimum  receiver.  In  this  ease 
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where  s  an  tin  .sample  values  of  the  known  signal. 

2.3  Composite  Hypothesis  Problems 

In  tin  signal  -  known- (  xnctly  example,  the  likelihood  ratio  gives  the  optimum  strategy 
tor  choosing  between  two  hypotheses  (1)  observation  was  due  to  noise  alone,  N,  and 
(2)  observation  was  dut  to  signal  mixed  v  ith  noise,  SN  For  the  signal-known-exactly 
case,  both,  hypotheses  an  termed  simple  hypotheses.  If,  however,  the  observation  under 
either  hypothesis  depends  on  some  parameter,  that  hypothesis  is  called  a  composite  hvpo- 
I  ties  is  An  example  of  a  compositc-signal-hypothesis  problem  that  has  appeared  in  it  e  liter¬ 

ature  is  the  problem  of  detecting  a  signal  known  exactly  except  for  phase.  There  the  parameter 
is  tin  unknow  n  pliaxi  angU  ,  ••  . 

Ttie  sporadic  problem  whicti  will  be  formulated  later  is  a  composite-signal-hypothesis 
problem,  the  parameter  is  the  signal  vector  ,  s.  The  optimum  receiver  is  then  one  which 
t  eali/es  the  average  itk<  It  hood  ratio 

f(xrx2”  •  •  X2VVT)  -  f'xrx21  •  ,x2vVt's)  l\,(s!SN)  (2'  3) 

all 

s  f  S 

The  probability  p  (s  SN)  is  the  probability  a  signal  s  (Sj,s9,  .  ,  s2Wt'  is  scnl  under  t,ic 

condition  that  some  signal-plus-nrnse  is  sent.  It  is  based  on  information  available  prior  to 

the  observation  (i  e.  ,  at  time  t  )..  The  likelihood  ratio,  f(x,,x„ . x„,.,_.ls),  is  the 

o  1  2  2  w  I 

likelihood  ratio  of  the  joint  observation,  (Xj.x^ . X2WT 


,),  conditional  to  each  specific 
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signal  s  that  could  occur.  Tht  entire'  ensemble  of  signals  i s  denoted  by  S.  Formally, 

Fq.  2.  3  says  that  the  detection  output  ol  the  optimum  receiver  is  obtained  by  tormina  tin 
individual  likelihood  ratios,  f(.\j,x,,,  .  s),  for  each  signal  and  averaging  them 

over  the  a  prion  probabilities  of  ilu  various  signals  that  could  >ccui  . 

As  ri  marked  earlii  i  ,  the  theory  of  signal  detectability  is  a  tla  >r\  which  provides 
for  the  insc  rtimi  of  the-  .i  priori  knowledge.  it  can  ha  rill  y  be  doubted  that  the  designer  of  tht 
receiver  has  some  knowledge  about  the  types  of  signals  for  which  the  mi  iu  i  is  being 
designed  to  observe.  I  his  a  priori  knowledge  appears  in  equations  bn  likelihood  ratio  in 
the  form  of  the  probabilities,  p  (s'SN).  A  wide  innge  of  initial  know  bilge  about  the  signal 
can  be  specified  by  describing  the  entirt  signal  class,  S,  and  assigning  values  to  tin  proba¬ 
bilities,  p  (s'SN).  As  a  special  case,  this  reetiwr  i  educes  to  a  singli  crosst  rrtlut  r 
when  only  one  possible  signal  could  bi  stilt,  since  p  fs.SNi  1  for  that  signal  and  /ei  lor 
all  others. 

2.  *1  Mi  m or y  and  Signal  Detectability 

1  lit  classical  theory  of  signal  tit  tectabi  lit  v  is  a  lull  memory  theory  the  implicit 
assumption  is  that  an  unlimited  amount  of  mentor'  is  available  with  which  to  realize  tin 
optimum  recent  r.  file  cost  of  providing  such  a  lull  memory  is  an  obvious  practical 
problem  in  certain  situations.  The  optimum  icceivers  for  the  synchronous  and  sporadic 
recurrent  waveforms  present  tins  problem.  I'nless  special  can  is  taken  in  obtaining  the 
proper  receiver  realization  for  these  cases,  an  impractical  amount  of  memory  may  be 
required.  It  turns  out  that  leali/mg  such  optimum  receivers  in  a  sequential  form  results  in 
receivers  with  practical  memory  requirements 

Although  optimum  nceiver  design  in  this  study  will  be  based  on  t fit  full  memory 
theory,  emphasis  is  placed  on  obtaining  optimum  receiver  realizations  with  adequate  but 
practical  memory  size.  There  is  no  theory  yet  developed  on  the  proper  utilization  of 
receive!  memory  but  the  study  of  the  manner  in  which  the  memory  is  utilized  in  adequate 
and  full  memory  receivers  should  contribute  to  an  eventual  theory  of  the  use  of  memory  in 
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signal  deti  (  lability. 


CHAPTKR  III 


ADA  I’TIV'I-  HKA  LIZA  HON  Oh  I'M h  OPTIMUM  HUCTTVKM 


3.  1  Adapliv  i1  !<>■(  i  i\  rr  Design  Plnli isopliy 

1 1 1 ;i 1 1 \  1  \ ,  thii  term  adaptive  receiver  conveys  the  requirements  of  a  time- varying 

structure  and  a  "learning"  feature.  As  is  i  vident  from  scanning  the  literature,  adaptive 
processing  schemes  an  not  unique.  The  plulosophii  al  discussion  of  what  constitutes  a  trui 

adaptive  device  is  not  cm  suit  red  lu  re. 

In  this  chapter,  .1  technique  is  developed  for  the  design  of  full-memory,  adaptive, 
optimum  receivers.  In  the  lull-memory  theorv  evolved  here,  the  term  "adaptive"  or 
adaptive  realization  is  used  to  label  forms  of  optimum  receivers  which  exhibit  adantive 
clwructeristics.  Although  not  considered  here,  a  different  theory  of  adaptation  would 
undoubtedly  result  il  a  receiver  were  to  be  designed  with  an  inadequate  memory. 

hull-mi  nmry  adaptive  reeeivt  r  design  may  be  approached  from  the  basic  viewpoint 
of  cl.issieal  signal  detei  lion  theory.  Tin  theory  must  center  on  the  primary  goal  of  making 
the  best  decisions.  The  mathematical  operaDons  that  an  adaptive  receiver  must  make  are 
I  lien  specified  by  the  theorv  It  will  be  shown  how  the  existing  theory  oi  signal  detectability, 
because  of  its  fundamental  approach,  enables  (he  synthesis  of  adaptive  realizations  of  the 
optimum  receiver.  This  puts  full-memory,  adaptive  signal  processing  within  the  framework 
of  the  theory  of  signal  detectability.  It  has  already  been  pointed  out  in  the  previous  chapter 
l  hat  the  optimum  receiver  under  many  criteria  is  one  which  realizes  the  likelihood  ratio. 

Then  may  be  seveial  different  realiza  1011s,  equivalent  ii  that  each  processes  the  input  to 
realize  the  same  icquired  likelihood  ratio,  or  a  monotone  function  of  this  likelihood  ratio 
The  peri  irmanre  of  these  realizations  may  be  equivalent,  however,  the  different  realizations 
may  have  unique  advantages  or  disadvantages  from  a  practical  point  of  view.  It  will  now  be 
shown  how  the  likelihood  ratio  can  lie  realized  in  an  adaptive  manner. 
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It  is  convenient  to  consider  first  the  adaptive  receiver  form  for  directly  described 
signals.  Direct  description  is  the  traditional  description  of  signals  in  the  classical  theory. 

It  becomes  more  convenient  to  use  an  indirect  signal  description  in  subsequent  chapters 
There  the  signal  will  be  described  indirectly  in  terms  of  a  smaller  emsemible-  of  waveloims 
and  a  time  structure  where*by  these  short  waveforms  are'  assembled. 

3.  2  Adaptive1  Realization  of  the  Optimum  Hecctve r  -  Direct ly  Desc r l bed  Sipnal  Kiisemime 

The  adaptive1  re'Ceove'r  realization  which  null  be'  de-v  e  lnpewi  in  this  se*ct|on  opt rate's 

sequentially,  so  that  in  eve  ry  "j  seconds  the  observations  m  the'  past  :  see'  oiids  are  pi  oe  esse 

Exempt  where'  otherwise'  noted.  the'  notation  use'd  throughout  is  that  X  deuiote'S  \(t)  (or 

0  t  k~,  .end  x.  denotes  x(t)  lor  (k-1):,  t  k~,  In  othe’r  words,  a  capital  letter 
--lk  1-1  ‘ 

indicates  the1  obse  rvatmii  Irom  the  bepmu'np  oi  Mine  to  now  (i  r  ,  k'^)  and  the  lowei  case1 
letter  refers  to  the  preseuit  observation  uhii'h  is  to  tie*  processe'd  as  a  unit  Sequentially 
in  time  the  receiver  updates  whethe  r  the  sipnal  was  or  was  not  present  in  the'  entire' 
observation,  X^,  and  the'  opinion  is  updated  as  to  which  sipnal  it  is  il  mdee  I  signal  is  present 
Classical  signal  detention  theory  is  a  fixed-time  the-ory  That  is.  much  nl  the  work 
in  the  past  involved  re'ceover  desipii  in  which  the  processing  lime'  was  chosen  hclore  building 
tile'  re'Ceuveu  .  However,  m  an  adaptive  approach  t tic  processing  time  remains  variable'. 
Actually,  classical  fixed-time  theory  only  appe  ars  to  speedy  a  lixeel  obsei  vation, 

The  the'ory  is  euisily  pen*  rail  /eel  to  permit  a  mi  iver  w  hie  li  operates  over  a  variable  time1 
interval.  In  partie  ulai  ,  if  the1  optimum  reeciveu  is  ,o  be  ele  sipne'd  to  woi  k  on  the'  time' 
interval  (0.  k'j).  then  the  optimum  reeeiver  is  one  which  -e-ali/es  the'  se-quence  of  the 
likelihood  ratios.  f(X.  f(X.,).  ,  1  X ,  1  his  receuve'i  provides  the  output  which  is 

1  1  K 

necessary  bu  maktiip  the  he's!  decision  as  to  pre  sence  or  abseiie'e  of  .sipnal  Irom  time'  zero 
In  linn  k  *  | .  a  nil  doe  s  so  in  a  running  or  sequent  la  i  las  hi  on  The  i  ipt  i  nr  mine'. ss  ol  liked  i  hood 

ratio  guarantee's  t t  all  available-  information  prior  to  time  zero,  alonp  with  that  available 
Ir  mi  the-  observation  I’se  ll  lias  tn  on  use-el  to  make  an  optimum  decision  as  to  preseuice'  or 
absence  o|  sipnal  in  the  e  ntire  runmup  t’.me  nit' aval  (0,  k  t  ^ ) .  This  is  called  a  lonp-term 
eieU  e  e  1 1  on  pr obi  eun. 

The  sequt  nee  of  likelihood  ratios,  f  ( X , ) .  f(X„),  .  .  ,  <  ( X.  ),  could  be*  obtained  at 

12k 

each  turn  k'j  by  repeated  application  of  hep  2,  3.  This  equation  suppe  sts ,  howe  ver,  that 
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one  stort  ct  1 1  p.i  t  observations  ns  well  as  all  the  probabilities  up  to  time  k*  j  A  press 
block  diagram  of  this  realization  is  shown  m  Pip.  3.  1.  Tin  samples  of  the  observation 
art  stored  an  input  memory.  In  addition,  U  is  necessary  to  make  provision  for  sturape 
of  all  tin  a  prion  probabilities,  p  Is  SN).  Tin  storape  requirements  for  both  these  purposi  s 
m  reast  as  dmt  im  reuses,  which  makes  this  type  of  realization  impractical  in  many  case-. 


Detect  ion  Output 

f(X,  I 
k 


Hp.  3.  1.  Or oss  block  diaprarn  of  a  nonsequential  receiver  realization. 

Another  wav  >(  forminp  these  likelihood  ratios  is  to  derive  f(X,  )  from  the  previous 

k 

one,  f  ( j  topether  with  the  kt  h  observation,  and  a  set  of  updated  probabilities  Several 
ot  the  I  or  ms  which  these  realizations  can  take  will  be  considered  later  This  study  is  con¬ 
cerned  primarily  with  this  approach  and  its  implementations.  This  approach  is  especially 
interestinp  because  it  leads  to  realizations  which  exhibit  the  features  of  an  adaptive  type  of 
processor  First,  however,  tlusi  lull-memory  adaptive  realizations  are  shown  lobe 
related  directly  t<>  tlu  oriptnal  likelihood  ratio  by  an  equivalence  transformation. 

3.  2.J _ Sequential  Realization  ol  Likelihood  Ratio  -  Independent  Observations 

C  onditi  >r.i  1  to  SN.  M.inv  classical  detection  problems  have  dealt  with  the  situation  where 
eitht  r  tlu  ,-ipnal  transmitted  was  .ndependently  chos.  n  from  tin  sipnal  ensemble  in  each 
unit  ol  oh st  i  cation,  x  or  where  only  one  possible  known  sipnal  could  be  transmitted 
throuphout  the  entire  observation,  X  The  latter  is  the  classic  SKF  (sipnal  k.aiwn  exactly) 
ease  Lnder  certain  conditions,  this  results  in  a  simple  recursive  equati  >n  for  obtaining  the 

likelihood  ratio  of  the  observation,  X,  ,  from  the  likelihood  ratio  of  the  observation  X, 

k  k- 1. 


de  fmition 


To  illustrate  this,  consider  that  the  likelihood  ratio  of  the  ol.se  ration,  X,  ,  is  In 

k 


MX  :sm 

f(V  T[x:  *M  ,;i-' 

it 

It  is  assumed  that  the  observations  an  liidepeiu  enliy  distributed  under  the  background 
condition  of  noise  alone.  The  independence  of  the  observations  under  noisi  alone  pe  rmits 
computation  of  the  probability  density  function  for  a  section  of  observation  from  a  simil.tr 
probability  function  for  shorter  sections  multiplied  by  the  probability  density  function  for 
the  most  recent  section.  Thus 


MX,  N)  MX,  ,  N;  1(\,  M  Cl  J) 

k  k- 1  k 

Since  the  observations  are  assumed  independent  under  the  c  indition  SN,  the  probability 
density  function  of  the  observation  under  the  condition  signal  plus  noise  can  lie  similail. 
separated  so  that 


MX.  SN  ,  t( X  ,  SN)  fix,  SN)  ( 3.  3) 

k  k- 1  k 

Substituting  heps.  3.  2  and  3.  3  into  3.  1.  the  likelihood  ratio  can  be  written  as 


■(xk-l SN) 

"N"^1 

MX  ,  1  N ) 

f(\,  N) 

k- 1 

k 

Applying  Kq.  3.  1,  which  is  the  definition  of  likelihood  ratio,  IN c j  3.  4  can  be  written  as 

f(X,  )  f(X,  ,)  f(x.  )  (3.3) 

k  k- 1  k 

for  independent  observations  under  SN  with  independent  noise,  the  likelihood  ratio  of  the 

total  observation,  X  ,  is  the  product  of  the  likelihood  ratios  of  the  independent  parts, 
k 


For  example,  this  is  the  assumption  in  Helsirom,  Statistical  Theory  of  Sipnal  Detection, 
Chapter  III  Section  4,  "Sequential  Testing  of  Hypotheses. 
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Detection  Output 

f(X,  ) 
k 


l  ip.  3.2.  Optimum  sequential  receiver,  independent  observations. 

A  simple  block  diagram  of  a  receiver  which  realizes  Eq.  3.  5  ;s  shown  in  Fig.  3.  2. 
-\!t<  i  tin  first  mu!  of  observation,  a  likelihood  ratio  f ( X ^ )  is  computed.  This  is  stored. 

Ellen  the  likelihood  ratio  Ha,  of  the  next  unit  of  observation  is  computed  and  multiplied  by 
f(Xj)  ti  form  f(X.j)  which  is  stored.  This  procedure  is  iterated.  This  is  a  sequential  form 
I  an  optimum  receiv  er. 

3.  2.2  Sequent ia I  Realization  of  tin  Likelihood  Ratio  •  Dependent  Observations 
(_onditi  m. 1 1  to  SN  In  this  section  it  is  shown  how  the  likelihood  ratio  of  the  observation  over 
a  n  interval  (0,  k"  j )  can  be  tea  1 1  zed,  in  a  I  as  hi  on  cqui  valent  to  the  above ,  for  cases  where 

tin  ib s i  rvations,  v,  are  dependent  under  itie  hypothesis  SN.  This  is  the  situation  in  a  com¬ 
posite  hypothesis  problem.  The  derivation  begins  with  the  likelihood  ratio,  f ( X,  ) ,  o.  the 

K 

i  nt  1 1 1  obsi  rvation,  X^,  winch  is  known  to  In  optimum  under  many  criteria,  and  transforms 
f(X  (into  an  equivalent  se(|uential  form 

One t  more,  vv t  start  from  the  likelihood  ratio  'if  the  observation  X  ,  given  by 

K 

f(X  I  SN) 

f(X  )  - - -  (3.  1) 

f(Xk  I  N) 

As  be  1  or t  .  the  obsi  rvations,  x  an  assumed  independent  when  noise  alone  is  present,  so 
Kq  3.  2  applies.  In  composite  signal  hypothesis  problems,  however,  Eq.  3.  3  does  not  hold 
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and  f(X^!SN)  is  written,  instead,  by  definition  of  conditional  probabilities,  as 


5SI  llVlISNI"VXk-rssl 


(3,  6) 


Thus,  f ( X  )  can  be  written  .us 

k 


nxk) 


f(X.  .  ISN) 

k- 1 

»Xk-l  N 


"Vxk.rSN 

f(\  N) 


(3  7) 


or 


MXk) 


f(X 


k- 


,» -Vi1 


(3.  8) 


when  w  e  ha  ve  defined 


f('\  \- 


Xk_rSN, 

f(xR  N) 


(3.  9) 


Note  that  Lq.  3.  8  is  similar  to  Kq  3.  5  except  that  the  fut  ction  fix,  X,  )  is  dependent  on 

K  K  ■  1 


tlu 


•  entire  past  observations  in  addition  to  the  unit  observation,  x,  . 

K 

Let  us  now  determine  f(x.  X.  To  do  this,  let  us  consider  in  more  detail  the 

k  k- 1 

numerator,  fix  X  SN).  ol  fq.  3.9  Soiling  Kcj  3  fi  for  fix  IX,  . ,  SN)  one  obtains 

K  K  -  1  KtN'l 


xk-r  S'N‘ 


^  SN) 
f,xk-i  S'N) 


(3.  ic; 


i'he  numerator  ol  hq.  3  10,  by  definition  of  a  composite  signal  hypothesis,  is 

f(X,  SN’  f(X,  s,  SN)  p  Is  SN)  dx  (3.  1  1 ) 

k  k  o 

when  f ( X k  '  s ,  S N )  is  the  pr  'liability  density  function  of  the  obsc  n  ation  X  under  the  condition 
SN  and  when  a  specific  signal,  s,  is  being  transmitted  At  the  start  of  tin  obs<  nation, 
specified  as  time  t  the  observer  us  uncertain  as  to  the  specific  signal  to  be  sent.  This 
uncertainty  is  expressed  by  the  probability  density  function,  p()(s  SN).  If  the  .'iigp.il  is  simply 
added  to  the  noise,  then  the  observations,  conditional  to  a  spec  ific  signal,  s,  are  independent. 
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Thus 


f(Xk  s.SN)  f(X  s.SN)  f(x  s.SN)  (3.12) 

Substituting  Fq.  3  12  into  3.  11  results  m 


l<  X.  SN)  f(X  ,  s.SN)  fCx.  s  SN)  p  (s  SN)  ds 
k  s  k-l  k  o 


(3.  13) 


Kqu.ition  3  10  tin  i  t  (  h  i  becomes 


f(\  Xk-  r  SN) 


f(X.  .  s.  SN)  p  (s  SN) 
k-  1  _o _ 

f(Xk-.  SN) 


f(  x.  s,SN)ds 
k 


(3.  1-1) 


wheie  l(XR  |  SN)  has  been  incorporated  in  the  integrand  since  it  is  independent  of  the  variable 
of  integration.  It  is  natural  to  define  a  new  probability  function  for  the  signal  ensemble  based 
upon  all  the  observations  up  to  time  ( k -  1  > r  This  is  done  by  singling  out  the  bracketed  term 
of  Ftp  3.  14  and  defining  it  as 


p.  ,(s  SN) 


f(Xk.j  s.SN)  pf)(s  SN) 
f(X  j  SN) 


(3.  15) 


Substituting  Kq.  3.  15  into  3.  14,  one  can  write  f(x  X  SN)  as 

K  K  ~  I 

f(xR  XR  j.SN)  f(xR  s.SN)  pR  j(s  SN)  ds 


(3.  16) 


winch  is  in  direct  parallel  to  Fcj.  3.  11,  except  that  the  weiphtmp  pr  bability  is  not  the 
original  defining  density  a'  t  but  is  an  up-to-date  probability  function  based  upon  the  obser¬ 
vations  nve i  all  the  time  up  to  the  last  unit  of  observation.  The  probabilities,  p.(slSN), 

K 

can  also  be  obtained  I  rum  p,  As  SN  rather  than  p  (s  'SN).  We  can  rewrite  rJq.  3  15  with 

k-l  o 

the  subscript  mdexi-d  ahead  by  one, 


pR(s  ISN) 


f(X  s.  SN)  p  (s  ISN) 
K_  '_U _ 

f  ( X  R 1 SN) 


(3.  17) 
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Solving  Kq.  3.  15  for  p  (s'SN)  .uui  substituting  tins  into  Kq  3.  17  results 


pk(s  SN) 


ft  X,  s.SN) 

k _ 

"Vl  *-SN> 


MX  ,'SN) 

MX  SM 
k 


(3.  1H) 


Thi'  ratio  in  tho  first  bracket  is  conditional  to  the  .signal  s  and  so  Kq  3.  12  holds  Similarly 

tlu  reciprocal  of  tin  ratio  in  the  second  bracket  is  !(\  X  ,  SN)  by  Kq  3.  G.  Therelon 

K  K  *  1 

Eq.  3  18  becomes 


p  (  s  1  SN) 


i  ( V  s.SN) 
k 

j  f  ( X ,  X.  ..SN) 
1  a  k  - 1 


i:k  1'S  SNi 


(3.  19) 


VV”  have  still  to  get  the  form  of  I  q  3.8  for  likelihood  ratio.  i'sing  Kq.  3.9  for  the 
definition  of  f ( x j)  along  with  Kq.  3.  16  one  gets 


/O  f(Xk  S-SN)l 


(3.  20) 


where  f(\  N)  has  been  brought  inside  the  integral  since  it  is  independent  o|  tin  variable  of 
integration.  Define  a  likelihood  ratio  ol  tlu  unit  observation,  \  ,  condition.:!  to  a  specific 

K 

signal  as 


f(X,  s) 
K 


K.v.  s.SN) 
k  _ _ 

f(  v.  N) 

K 


(  3.  2  1 ) 


then  the  conditional  likelihood  ratio.  f(y  X,  ,)  can  In  written  as 

k  k  -  1 


'Wo1  s  «\  »  SNOS 
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Similarly,  il  mum  rator  and  denominator  of  Kq,  3.  19  are  divided  bv  fix,  N)  and  Kqs.  3  9  and 

k 

3  21  are  used,  'he  updating  equation  can  be  written  as 


Pk(slSN) 


r  f  ( X  k  '  s ) 

K,xk-i> 


pk-l(s  S'N) 


(3.  23) 
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Fquations  3.  8,  3.  22,  and  3.  23  form  tin  basis  of  design  of  the  sequential  receiver.  Table  3.  1 
summarizes  tin  basil  sequential  receiver  design  equation  for  both  dependent  and  independent 
il)s<  r  \  at  i<  ms  und<  i  SN 


TAU1  K  3.  1 

HA  SIC  RFCFIVFK  DI-SIGN  FQUATIONS 
Sl-.gri-  N'TIAI  HKA  I.IZATION  Of  THf  1  IK F I  IHOOD  RATIO 


Independent  Oiiser Cations  Conditional  to  SN 
Detection  Output 


f(Xk)  r(Xk_1W(xk)  (3.5) 

Dependent  Obsers  alums  Cunditnmal  t o  SN 
Detection  Output 


,,xk-»M(Vxk-.) 

Sequential  Average  Likelihood  Ratio 

f(\IXk-l'  '.  Mxkls)  ,V|(s.SN)  ds 


Classification  Output 


Pk<s  SN) 


"V"1 

"NVi1 


l>k_ ,( sISN) 


(3.  8) 


(3.  22) 


(3.  23) 


II v  t  ompanng  Ftps.  3.  22  and  3.  23  we  observe  the  primary  earmark  of  adaptive 
opt  ration:  tin-  feedback  >1  results  to  modify  the  processing  of  subsequent  observations, 
rims  Ir  mi  p  ( s  SN)  and  x ,  one  can  calculate  p.(slSN).  This  is  used  to  determine  the 
wt  i  gilt  mg  on  \  ^  (Ftp  3.  22)  which  in  turn  is  used  to  compute  p^fsISN)  and  so  forth.  The 
quantities  calculated  are  shown  in  f  ig.  3.  3. 
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f,V 

•Vs  SNt  -\ 

\ 

- g - 1 - - f. 

Vl  \  Vl 

!  l  m< 


Fit;.  3.3.  Sequential  realization  representation 


It  us  likely  that  one  could  arrive  at  l-qs,  it.  22  and  3  23  In  proper  application  of 

Bayesian  logic.  The  author  has  overtly  chosen  not  to  do  this  so  th.it  it  is  obv  ious  that  the 

a  foi  ement  limed  equations  hr  conditional  likelihood  ratio  anil  lot  updating  knowledge  are  a 

result  of  simple  mechanical  manipulation  ol  the  formula  for  likelihood  ratio  of  a  complete 

observation,  X, 
k 

A  block  diagi  am  indicating  the  operation  of  thus  adaptive  receiver  ns  shown  in  k  ip  3  -I 
The  likelihood  ratio  of  the  incoming  observation  is  computed  lor  each  possible  signal  that 
could  occur  These  individual  likelihood  ratios  are  then  weighted  by  up-to-date  probabilities, 
p^  j ( s  SN).  as  in  which  signal  us  beinp  transmitted,  and  these  products  an  added  over  all 
st  S  to  obtain  the  conditional  likelihood  ratio  ffx.  X  . I'he  information  regarding  which 

K  K  -  1 

sipnal  is  present,  as  expressed  by  p  . ( s ) ,  us  then  updated  using  the  quantities  fix,  si  and 

f(\  X,  .)  which  contain  new  information  from  tin  kth  observation  a.s  to  which  signal  is  being 

transmitted.  This  forms  the  up-to-date  probabilities,  p  (s  SN),  which  will  be  used  lor 

k 

weighting  the  individual  likelihood  ratios  ol  the  ( k *  list  observation  In  addition,  p  is  SN) 

K 

can  be  displayed  t  ipt'ovidi  classification  information.  The  purpose  of  this  section  has  In  en 
to  show  how  to  design  optimum  dcte<  tion  equipment  which  has  a  property  normally  associated 
with  adaptivi  equipment  namely,  the  property  of  utilizing  observations  to  u.i  rrase  know¬ 
ledge  and  using  this  knowledge  in  inti  rpreting  subsequent  obsi  rvations. 

We  have  seen  how  the  equation  for  updating  knowledge  as  to  which  signal  was  being 
transmitted  (Fq.  3.  23)  gave  a  learning"  feature  to  the  receiver  design.  This  feature  was 
absent  in  the  realizations  discussed  in  Section  3.2.  1  since  it  was  assumed  that  either  (1) 
the  signal  was  known  exactly,  in  which  case  only  the  central  question  of  its  existence  remains, 
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or  (2)  tin  signal  samples  in  sunt  ssi\ e  observation  units  were  independent  in  which  c  um 
what  is  learned  in  one  unit  is  irrelevant  to  observations  m  any  -uirr  unit. 

3.  3  C lassjl icat ion  of  Signals  in  Noise 

Frequently,  mon  than  just  pri  eiu  e  or  absent*  ol  sipual  inf  orniati  on  is  wanted  li  uni 
tlte  receiver.  In  classical  detection  problems,  information  as  to  whiih  sipnal  was  in mp 
t  rans  mtl  ted  was  often  uppressed  This  resulted  liom  iti  fact  that  the  riciivii  was  designed 
to  ailMUT  the  question  of  pi  es mice  m  absence  t  sipna  1  i  i  pa  ■  dies s  of  the  pa l  t  u  ula i  si  pint  I 
t  ra  ns  m  it  t  etl.  Tin  realization  of  hip.  3.  4  displavs  the  c  lassilicat  mil  information  who  ti  has 
always  been  inherent  in  .hi  formation  ol  tin  ;  <  i  cm  i  detection  output 

p  (s  SN)  is  the  probability  density  fum  (ion  that  i  cpi  esents  oui  opinion,  prior  to 
any  obser  v  at  ion,  as  t  >  which  sipna  1  will  be  present  1  Ins  is  the  class  if  k  at  mu  output  at  time 

t  As  has  been  shown  in  the  ill  evimis  section,  undated  \t  i  sinus  o|  tins  density  luiii'timi. 

o  '  1 

p,  (s  SN),  an  obtained  sequentially  in  time  by  the  receive!  and  used  to  lot  m  the  di  tectm. 
output,  i.e.  ,  the  likelihood  t  atm.  thus,  the  detection  ami  classification  aitputs  an  obtained 
simultaneously  and  an-  mtimati  ly  relatiii. 


t'UAPTI.R  T \ 


I*  DIRKi  I  DKSC  RII’TION  OF  SIONAI  FNSKMIUJ- 

In  C  haptt III  I'  wa  shown  that  an  optimum,  full-memory,  adapt t \ «*  receiver  design 
could  !n  put  within  the  framework  of  classical  fwcd-time  theory.  The  basic  form  for  an 
optimum,  full-memory,  adaptive  receiver  was  obtained  there  for  the  case  where  tfu  signal 
ensemhl  i  is  dest  ri  tied  di  redly.  II  the  design  equal  ions  (  Kqs.  3.  8,  3.  22  and  3.  23)  a  re  applied 
directly  to  the  case  of  recurrent  vv.sv clortns,  tile  resulting  realizations  still  require  a  contin¬ 
ually  growing  memory  lor  storing  updated  probabilities,  as  we  shall  see  in  Chapter  V, 

In  tin  next  two  chapters,  it  will  lie  shown  that  optimum  adequate-memory"  adaptive 
receiver  th  -.igns  will  be  obtained  lor  detecting  the  recurrence  phenomenon.  An  optimum 
"adequatc-nirmor  >  rcci  iver  is  one  that  h..  s  sufficient  memory.  In  developing  a  theory  for 
the  design  of  an  'adequate-mi  mory  receiver,  an  indirect  description  of  the  signal  ensemble 
p rov  i  s  usi'luh 

•F  J_  Component  Knsemble  and  Time  Structure 

The  input  vi  ltages  to  the  receiver,  which  are  functions  of  time,  are  assumed  to  be 
defined  for  .ill  times  I  m  the  observation  interval.  O'  t  T.  They  are  assumed  to  be 
limited  to  a  hand  of  frequencies  of  width  VV.  My  the  sampling  theorem,  each  receiver  i  iput 
can  he  thought  of  as  a  point  m  a  2vVT  dimensional  space,  the  coordinates  of  the  point  being 
Hie  value  of  tin  function  at  tin  sample  points  t  jTydf  •  f°r  '  J  2WT.  The  notation 

X  di'in  .i  cs  a  leceiver  input,  . \  ) ,  where  k  2vVT  and  x  denotes  the  Jth  sample 

K  »  l.  K  J 

v  a  I  ue,  oi  i  i  M  u  dlllate. 

To  state  tin  problem  of  deteei.nv  presence  or  absence  of  the  recurrence  phenomenon 
within  thi'  terminology  of  signal  detection  theory,  it  i‘-  necessary  to  clarify  what  is  meant 
In  rv  l>y  tin  word  signal.  "  This  word  is  often  used  loosi  ly  and  sometimes  means  the  noiae- 
fn  i  i  miss'on  from  a  transmitter,  whereas  at  other  times  it  refers  to  the  noise -contaminated 
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waveform  at  the  receiver  input.  In  tins  study  a  signal  is  tin  voltage  waveform  it  the  receive1 
input  when  noise  is  not  present. 

In  hip.  1  i  lour  typical  segmi  nts  of  signals  of  the  type  of  interest  here  wen 
shown.  A  possible  signal  is  shown  in  I- ig.  4.  1  There  arc  intervals  of  no  energy  interrupted 
by  occasional  occurrences  of  the  same  waveform.  I  his  short  w  a  eform  is  called  a  si  pint  I 
component  or  simpl>  a  component.  A  signal  consists  of  a  recurrence  of  tin  same 
component  and  the  blank  .spaces  in  between. 


Signal 

y* 


“U‘LJJ 


I  I  t  *  I  1  1  I  l  I  1  I  t  t 


4  5 


turn 


( ’( imp1  oxiit 
Oci  urret  >  >  s 


Fig.  4.  1  A  signal  composed  of  components 


Th“  notat  ion  s  denotes  the  signal,  I  •  s,, . si,  as  it  would  appea  r  .it  tin  teceivei 

1  4_  K 

input  ill  tin  absent'*  of  lloist  when  s^  ilenotes  the  jth  sample  valui  .  or  cooidinati  ( 
denotes  a  particular  componenl,  Ic  ,  c  9,  .  .  c  ),  where  c  denotes  the  jth  sampli  of 

'  ’  “  ''  1  i  *'  ■* 

th>  ith  cor.,ponent.  Anv  value,  including  /ex  ■>,  c.ti  be  assigned  to  these  samples  Bv  the 
sampling  theorem,  a  component  can  be  thought  of  as  a  point  in  a  2WT  dimensioi  al  space  , 
where  Tj  is  the  duration  of  the  component.  Since  the  duration,  T  of  a  component  ca  be 
diffident  for  each  component,  the  number  of  component  samples  or  coordinates  in  a  component 

is  denoted  by  n  where  n  is  equal  to  2\VTj  for  the  ith  component.  For  example,  if  the 

1 

component  in  hip.  4.  1  is  labeled  C  ,  then  n^  7  and  it  is  written  .is  C 
and  tlvc  signal  in  the  interval  (0,  t^j  is  written  as 


1-11,1,-!,  1,  1,  -  II 
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In  Mi  di  r  t<  def’.nt  (hi  i li  t < ■(  1 1 1 m  p t  .bleu  it  is  lien  s.sury  to  specify  tin  initial  signal 
uncertainty.  This  is  must  conveniently  dune  by  describing  the  signal  indirectly  in  terms  of 
components  and  their  timing,  thus  distinguishing  two  types  ot  uncertainty:  unn  rtainlv  as  to 
component  charactei  and  recuri 'em  e-tn  a  uncertain! v.  Consider  the  block  diagram  shown 
in  Fig  -1  2.  ()  e  ('niiipii  ,  :  i  nut  it  .i  In  ite  class  i!  b  components  is  chosi  by  the  c  iiiponent 
gener.ibu  t  >  In  i  haiacti  nstu  of  a  i  r  a  ns  nus n  in  at  its  outset.  Transmission  of  the  character¬ 
istic  e oni poiiee t  ..  rs  mh  upon  ci.mma  ul  ny  the  trmger  generator  winch  introduces  the 
r  if  u  i  relic  i  - 1 1  m  i  unc  *  1 1  a  mt  y  1  i  tggi  i  s  n  a\  m  c  u r  ml  y  a  t  disc  ret  <  limes  and  mat  not  occur 
uiihii  a  comp,  an  nt  l'lireo  basic  dist  i  i  but  n  ns  >1  lecurn  e- time  intervals  are  considered; 
tin  Sporadic  -  l’oisson,  the  Synchronous  Poisson,  and  the  Periodic.  Signals  of  the  three  types 
ait  illustrated  i!  big.  1  J  and  dc  lined  below.  Ida  i  1 1 1 jx »n c ■  1 1 1  is  not  restricted  to  a  binary 
yyay  elorm  but  is  stum  n  as  such  lor  illustrative  purposes.  In  particular,  a  component  can 
true  /ci  o  sample  yalues,  thus  permitting  signals  mmposect  of  periodic  pulses  to  be  described. 


Tl Iggfl 

<  niponent 

( ic  in  i  at  or 

nun  rat  ■ '! 

Pip.  4.2  Miock  diagram  of  signal  gc  neralor. 

Ilii  si  iii,  test  te  :  poial  distribution  of  compcinents  within  .i  signal  occurs  for  a 
Pc  ;  iodic  l  ime  Structui  c  .  In  this  i  ase  a  con  p  >r  ent  is  transmitted  periodic  ally  with  period 
I  j ,  win  re  1  is  the  duration  of  a  compone  nt.  Such  a  signal  is  shown  in  Fig.  4.  3  c.  With 
the  Sporadic  - Poisson  Time  Structure,  there  is  a  probability  ot  initiation  ol  a  Component  at 
cacti  ol  the  times  t  kr  ^  that  is  /<  n  within  a  component  and  invariant  at  other  times.  This 
type  of  signal  is  shown  in  Fig.  4.  3  a.  For  the  Synchronous- Poisson  Time  Structure,  there 


2H 


H 


.1,  Spot  atilt  -Poisson  I’l'nn  ss 
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Fu;.  4.  3.  I  ypic.tr  signals. 


is  .1  1 1 r i ■( i.t t m  1 1 [ \  that  ..  trigcii  will  occur  at  tin..  .  F  seconds  apart.  In  tin  iu*  t  thrct  sections 
tin  thrct  tvpcs  "I  time  pioci  .st  s  will  In  mathematically  defined. 

4.  2  Sporadic- Poisson  lime  St rue!  u r t 

Tin  signal  e us e m i >1 1  fur  this  timt  strueturt  can  lit  indirtctly  tlescrihed  i  terms  of 

the  components  and  tine  strut  tuit.  I  he  ktli  samplt  of  the  signal,  s  can  In  -defined  in 

K 

trims  1  if  the  (k-l)st  sample,  s  and  a  st>t  of  transition  probabilities.  In  other  words,  (lit 

signal  can  bt  defined  by  a  one-step  Mark  's  process.  In  the  sporadic  case,  a  samplt  of  the 

sicn.il  can  lit  m  any  of  the  states  c  ,,c  . c  for  i  1,  2 . b,  where  c  rorn  s- 

i ,  1  i ,  2  i ,  n  i,i 

i 

ponds  to  flit  jth  position  of  the  ith  component.  Their  are  b  components  in  the  component 
ensemble  and  the  ith  component  has  n ^  samplt  values.  One  other  state  is  possible  and  that 
is  when  the  ith  component  has  been  selected  but  is  off.  This  is  designated  by  c 


Only  certain  transitions  from  one  state  to  another  are  possible.  For  example,  if 


tin  component  has  seven  samples  and  s^  j  c.  ^ ,  then  s^  c.  ^  with  probability  one.  This 
is  a  result  of  the  fact  that  once  a  component  starts  it  must  tie  completed  and  also  no  new 
lumpomnt  mav  start  until  a  component  is  completed.  I'he  various  possible  transitions  are 
visualized  with  the  aid  of  Fip.  4.  T .  This  figure  shows  t lie  possible  states  of  the  (k-l)st  and 


k  - 1  k 


F-ip.  4.  4.  Sporadic-' Poisson  process  for  the  jth  component. 


kth  sipnal  samples  The  arrows  indicate  t lie  possible  transitions.  Also  included  on  the 
diagram  are  the  probabilities  of  the  various  transitions.  More  specifically,  the  properties  of 
the  Sporadic- Poisson  process  are  defined  as. 
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m's^l.s  j ,  S N )  0  otherwise 


(4  5 


The  interpretation  of  f-q.  4.  2  is  that  if  the  ith  component  is  either  off,  c.  q,  or  .it  its  last 

component  position,  c.  ,  at  time  t,  ,,  then  it  is  off  at  time  t,  with  probability  1-r.. 

i ,  n.  k- 1  k  i 

i 

Similarly,  from  Ftp  4.3,  if  the  ith  component  is  either  off  or  at  its  last  component  position 
at  time  t  . ,  then  the  ith  component  starts  again  at  time  t,  with  probability  r  .  Fquation  4.  4 
says  that  if  the  (j-l)st  posit'  ..  of  the  ith  component  is  present  at  time  f  ,  then  the  jth 
sample  of  the  ith  component  is  present  with  probability  one  at  time  t^.  Fquation  4.  5  says 
that  no  transitions  other  than  the  ones  expressed  by  Ftps.  4.  2  through  4.  4  are  possible, 

4,3  Synchronous  -  Poisson  Time  Structure 

The  Synchronous  -  Poisson  l  ime  Structure  is  intermediate  in  recurrence  time 
uncertainty  between  the  periodic  and  sporadic  processes.  The  component  selected  at  the 
start  of  transmission  is  one  of  a  finite  number  of  b  possible  components.  Due  to  the 
synchronous  nature  of  the  time  structure,  there  is  no  detailed  positional  uncertainty  of 
components  as  was  true  in  the  sporadic  case.  If  a  component  is  triggered,  the  time 
position  of  component  samples  is  known  exactly.  This  enables  the  component  sample  values 
to  be  combined  into  one  state.  C  n  (c.  c  c.  „)  is  the  state  t  hat  results  1 1  the  itti 

1,0  i,0  i,0  i,0 

component  is  selected  but  the  component  is  off.  (  ,  (c  , ,  c  . . c  )  is  the  stall 

i,  1  i.  1  i,  2  i,  n 

i 

that  results  il  the  ith  component  is  selected  but  the  component  is  on.  I  he  signal  vector  can 

be  "blocked  off"  into  n  -dimensional  segments,  each  segment  being  designated  by  S  for 

l  K 

it  thr  i,niii|)i m t * i it  in  A  3  h  in  labrtrd  C^,  thru  this  si^n.il  is 
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Thi  possible  states  an  1  transition  probabilities  are  shown  u;  Fig 
tin1  Synchronous- Poisson  process  are  defined  as 
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hip.  4.  5.  Synchronous-  i’oisson  process  (or  the  ith  component. 


The  aho\e  two  equations  express  ttie  fact  th.it  r  is  the  probability  that  ;t  component  will 
appear  in  tin  kth  synctir  minis  interval  and  l-i^  is  the  probability  that  it  will  not  appear  in 
the  kth  interval  independent  ol  its  presence  or  absence  in  any  other  synchronous  interval. 

4  -1  Periodic  rune  Structure 

The  periodic  process  represents  the  least  amount  4  time  uncertainty  of  the  three 
types  i  insidered  One  of  a  finite  number,  b,  ol  components  is  selected  and  recurs  period¬ 
ical!.  Tins  recurrence  process  is  completely  deterministic.  The  possible  states  of  s  and 

K 

the  transition  probabilities  .»re  slmvui  in  lit:  4.  h  Thi*  properties  of  *  he  Pt  i 'indie  process 
.1  r « 


p(s  Is  SN)  1  fur  s  c  ,  s  c. 

kk-1  k  i.j  k-1  t.J-1 


j  2.  3,  .  ,  n. 


Fquation  4  9  expresses  the  tact  that  the  jth  component  sample  of  the  ith  component  occurs  at 

t  i  m  t  t  if  the  t  j  -  list  component  .'■ample  of  the  ith  component  is  present  at  time  t  The 

k  k- 1 

interpretation  of  Fq.  4.  10  is  that  the  first  component  sample  occuts  at  time  t  it  the  last 
c  nnponent  sample  occurred  at  time  t^  j.  Equation  4.  11  states  that  no  transitions  other 
than  tin  ones  defined  by  Fqs.  4.9  and  4.  10  are  possible. 


Fig.  5.  1. 


Summary  chart:  signal  categories 
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it  is  necessary  tu  consider  the  adaptive  realization  for  the  Sporadic- Poisson  and 
Synchronous  -  Poisson  Time  Structures  because  of  practical  memory  requirements.  This  is 
a  facet  of  optimum  receiver  design  that  did  not  exist  m  the  periodic  case.  In  the  Periodic 
Time  Structure,  for  components  of  duration  1  .  there  art  the  same  numbei  of  signals  n  the 
signal  ensemble  as  components  m  the  component  ensemble  .»ftei  observing  for  a  turn  kTj. 

For  the  Synchronous- Poisson  Time  Structure-,  however,  tiu-re  are  2  times  as  many  signals 
in  the-  signal  ensemble  as  there  are  components  in  the  component  ensemble-  after  a  time  k T.. 

In  this  latter  case,  the  re-ceiver  designer  is  (act'd  with  an  exponentially  growing  signal  ense mbit 
If  the  receiver  design  is  a  nonsequential  one,  Kq.  2.3  is  realized  directly.  I  his  is  the  reali¬ 
zation  represented  in  Fig.  3.  1  and  it  requires  an  exponentially  growing  memory  for 
p  (siSN).  The  nonsequential  realization  is  therefore  usually  too  complex  to  be  practical. 

The  question  arises  as  to  whether  an  adaptive  realization  might  providt  a  practical 
optimum  receiver  design.  The  optimum  adaptive  realization  was  dist  ussed  in  Chaplt  r  III. 

The  basic  equations  for  the  adaptive  realizations  art  summarized  in  Table  3.  1  and  presented 
in  the  biock  diagu.m  of  Fig.  3.3.  The  form  of  tilt  adaptive  design  t-quations  m  Table  3.  1  is 
unsatisfactory  since  .  n  updated  probability,  p^(slSN),  of  each  of  the  entirt  signal  vectors,  s, 
up  to  time  t  must  still  be  stored,  and  this  it-quires  ai.  exponentially  growing  memory. 

K 

In  this  chapter  design  equations  are  obtained  of  optimum  receiver  realizations  which 
have  a  memory  that  remains  fixed  in  size.  The  order  of  presentation  of  the  receivers  is  from 
the  one  for  the  least  certain  time  structure,  the  Sporadic  -  Poisson,  to  the  most  certain,  the 
Periodic.  Four  realizations  art  presented  for  each  of  the  three  time  structures.  I  hese 
realizations  of  the  optimum  receiver  show  how  tin  detection  output  can  be  formed  i  many 
different  ways.  The  derivation  of  Reahzatioi  I  is  presented  in  this  chapter  in  detail  for 
each  of  the  three  time  structures,  as  are  the  results  of  Realization  IV .  The  remaining 
realizations  are  presented  m  Appendices  A  through  C.  Following  the  presentation  of  the 
receiver  realizations  for  each  tune  struetu- >.  ,  the  operation  and  use  of  the  memory  are 
discussed. 


5.  1  Optimum  Adaptive  Recei  v<  i  Design,  Spot  adic  -  Poisson  Time  Structun 

In  this  section  an  adaptive  realization  of  the  optimum  receive;  is  pi  es>  nted  for 
detecting  signals  with  a  Sporadic- Poisson  Time  Structure.  One  of  h  components  is  selected 
for  transmission  and  the  same  component  recurs  throughout  a  total  observation,  X,  .  Tin 

g 


35 


i  i  >mp< ini'iit.s  eed  not  ha  ve  Hit'  same  duration  nor  recur  with  the  same  duty  factor.  Due  to  the 
Sporadic  -  Poisson  Time  Structure,  there  is  local  positional  uncertainty  of  a  component 
occurrence.  Tlu  probability  of  triggering  a  component  at  any  of  the  times  k 7  ^  conditional 
t  i  si  li  i  turn  of  tin  ith  component  is  i  ^  unless  a  component  is  in  progress  The  state  diagram 
for  tin  ith  component  has  been  shown  u  f  ig.  4.  4. 

I  o  re\  o-w ,  the  lo|  low  mg  ba  sk  st  eps  are  toil  owed  in  t  he  d<  ri  vat  ion  of  t  he  opt  i  mum 
adaptivt  receiver  realization. 

1.  Form  the  likelihood  ratio,  f ( X ,  ),  of  the  total  observation,  X, 

k  k 

(fq.  2  < 


2.  Obtain  equivalent  sequential  realization  of  the  likelihood  ratio, 
f(X|  ,  i  which  tin  receivt  r  updates  information  after  each  unit  obs<  rvation,  x  (f.qs  3.  8, 

3.  22  a  at  3  23) 


3  Desertin'  signal  ensemble  in  terms  of  compo  units  and  a  lime 
structure  (Chapti  i  IV), 

In  this  section  the  properties  of  the  Sporadic  -  Poisson  Time  Structure  signal  ari 
used  along  with  fags.  3.  8,  3.  22  and  3.  23  io  obtain  the  adapt ivi  receivers. 


1  1  Sporadic-  Poisson  l  ime  Struclun  Peali/ation  I  The  derivation  o.  this 

sequent  la  I  lea  I  izal  ion  begins  with  the  specification  of  the  lik'd  i  hood  ratio  of  the  observal  i  on 

ovi  r  tin  interval  (()  t,  )  winch  is  known  to  be  optimum  This  likelihood  ratio  is 

k 

f  X  PX,  s)p  (s  S Nltls  1 5  I) 

k  all  k  ° 
si  S 

I  Chaplet  III.  it  was  shown  that  this  likelihood  ratio  could  also  b<  realized  in  a 
sequential  fashion  fin  result  was 


ft  X, 


I  X 


k- 1 
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((xk  X  j)  I  'tx  s)p  is  SN)ds  (3.22) 

all 
si  S 


and  tilt  information  regarding  which  signal  is  present  is  updated  by 


pk(s  SN) 


f(xk  s),,k-l(s  SN) 


'(xk  Xk-1] 


(3.  23) 


Foi  a  finite  number  of  possible  signals,  the  average  sequential  likelihood  ratio  as  given  by 
f-  q.  3.22  can  bi  u  ritten  as 

f(xk  xk •  ,J  !  <xk  s,l)k-l'S  SN)  (5  21 

Sf  S 


win  ri  tin  integration  has  beer  replaced  b  summation.  If  the  likelihood  ratio  of  the  kth 
samplt  of  the  obsi  rvation  depends  only  on  the  kth  sample  of  the  signal,  then  f(xk  s)  f(.\k  sk). 
This  is  a  condition  which  holds  for  signals  in  added  noise  In  this  event,  the  average  sequential 
likelihood  ratio  of  Ftp  5.  2  can  be  written  as 


xk-i'  :  vvi1*  ^  15  31 

sf  S 

This  is  still  a  .‘■ummation  over  all  thi  possible  signal  vectors  that  could  occur  during  tin* 
observation  Xk  One  can  rewnti  pk  j(s  SN)  so  as  to  include  the  generator  process  The 
vector  s  in  sampled  form  is 

l>k_l(s  SN)  l,k.i(s1's2'  ■■■skSN>  (5.4) 

My  delinition  of  a  joint  probaln  ity.  p,  .(s:SN)  becomes 
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Now  l’k.i(i,k  s  i  •  S'V  ,sk_j,SN)  is  tlu  probability,  before  taking  the  kth  observation,  of 
tin  kth  sample  of  the  transmitted  signal  under  the  condition  that  signal  and  noise  are  present 
and  oni  has  exact  knowledge  of  the  k-1  samples  of  the  transmitted  signal.  T  his  probability 


is  i  nt  a  1  j  iction  of  the  obserxalioi  but  only  of  the  previous  samples  of  the  signal.  However, 
the  state  or  the  kth  sample  of  the-  signal  depends  only  on  the  state  of  s^  j.  In  other  words, 

‘’k-i(sk  Si-V  ■ '  ’  sk-r SN)  VrSN)  (5-6) 

since  the  state  if  s  is  independent  of  the  states  of  Sj ,  s^ . Therefore  Eq  5.3  can 

l>e  w  ritti  n  as 
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Vi  SNUr(sk  VrSN)  (57) 


Now.  the  summation  is  over  all  the  ve-cteirs,  s,  m  the  total  space  S  of  signals  t tia t  could 
possibly  occur.  Expandin'',  this  summation  to  sum  over  one  dimension  at  a  time  of  the  signal 
vector  tor  each  of  the  K  possible  samples  give  s 
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Spue  the  sums  are  finite-,  the  order  of  summation  may  be  interchanged  m  any  d--sire-d 
fashion.  rims,  Hep  5.3  cm  be  written  as 


■x.  X,  ,1 
k  k- 1 


i  1 


i,  n. 


c  c . 

i  .  .  i .  n  i,i. 

t  i  l 


i ,  n 


s ,  c  „  s ,  ,  c  s  c  sc.  s  c 

k  i.O  k-i  i.O  1  i,0  2  i,0  k-2  i,0 


f(xk  VrSN)-Vi(srs2-  "VI  SN) 


(5.  9) 


Now  ((xk  Sj_)  depends  only  on  the  summation  over  s^,  and  g(s^  j ,  SN)  depends  only  on  the 


summation  over  s,  and  s.  .  Factoring  these  terms  out  gives 
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The  term  in  brack. ts  is  a  joint  probability  of  k-2  variables  summed  over  the  first  k-2 
variables  This,  by  definition  of  marginal  probabilities,  can  be  written  as 
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This  permits  us  to  write  Lq.  5.  10  as 


i.  n. 


l.  n. 
1 

\ 


f(-\xk-i);-  -  ,(W 

l  1  s.  c.  n  s,  .  c  n 

k  i .  0  k- 1  i.O 


^(sk  sk-rSN,‘WVi  SN) 


[5  12) 


Mar  y  of  the  pis,  rs  S N )  terms  of  Tq.  5.  12  may  be  zero,  depending  upon  the  generator 

K  K  -  l 


Poise, on  process  are 


Vl,SN. 


“,sk  VlSSI 


firr  < 


geii«' 

rat  or  process 

for  tin 

r 

'Vo-  sk-l 

L  i ,  0 

\ 

_sk 

l'i  O'  sk-l 

'■•V 

r 

sk  1 

1 .  r  sk  -  1 

Vo' 

k.S  k  c 

i.  1  .  V  1 

C 

*•  J 

N  2) 


(4  3) 


tt(-1’k  hk_rSNl  1  (or  V  .• 


s ,  ,  c . 


k  i.j'  k-1  i.J-1 

j  2.  3  ....  n 


(4  4) 


VrSN  0 


otlu  rwise 


(4.  5) 


Substituting  these  generator  properties  into  Kq.  5  12  gives 
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n\  Vi> 


1Y1-1i)  *Vi(fs 
1  ! 


,V'‘,V  Pk-l<Mk-l  ci,  0  SN|  •  'Vl'Vl  c,.„.  m  ,lxk  %  S.O* 
'  L  1  J 


i-3ix,  s  c  )  p  (s.  ,  c.  SN)  *  p  (s  -c.  SN) 

i  k  k  i,l  k- 1  k- 1  i,0  k- 1  k- 1  i,  n. 

i 


fix.  s  c.  )p  .  (s  c  ,  SN) 
k  k  l,  j  1  k- 1  k- 1  i,  j- 1 


(5.  13) 


Mow,  t  q  lias  tl»  value  zero  and  for  a  known  signal  u,  added  white  Gaussian  noise, 


r(xk  -v  ‘‘ 


N  Xk  Sk  '  2 


(5.  14) 


when  N  is  tlu  noise  power  in  the  bandwidth  VV  Therefore 


f(xk  sk  ci.o)  f(xk  sk  0)  1 


(5.  15) 


For  eonv  nienee.  let  us  use  the  notation 


b.  <k)  p  (s,  e  SN) 
t ,  I  k  k  i,i 


(5,  16) 


The  ii  terpretation  of  the  probability,  b^  ^ k)  is  that  it  is  the  probability  that  the  signal  sample 
.it  time  t  is  the  jth  sample  of  the  ith  component  under  the  condition  that  signal  and  noise  are 

K 

present  and  that  the  previous  k  observations  have  been  seen  Using  the  b  ^(k)  notation 
along  with  the  definition  of  f(x  s  e  _)  for  signals  in  added  white  Gaussian  noise  as  given 

K  K  I ,  U 

by  Fq  5  15.  om  obtains 


b 

r 

- 

r  ~ 

k  Xk-1 

i  1 

^  <i-i . 
1  1 

)  b.  n(  k- 1 )  *  b.  (k-1)  * 
i,0  i,  n 

l  <(x,  s.  c. 

i  k  k  i, 

I1  ,l,G|k-1|,bU|k-11 

L  i  J 

f'x.  s.  c.  )  b  .( k - 1 ) 
k  k  t,  j  i,  j- 1 


(5.  17) 


A. 
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Factoring  out  b.  Q( k- 1 )  *  b  ^  { k - 1 )  permits  Eq.  5 


17  to  be  written  as 


«\  ,„k- » •  <k-" 

*  i 


k  1  -*  )  •  *•- f(x,  s,  c.  .) 
1  i  i  k  k  i,l 


a. 


1  2 


Ox,  s,  e,  )  b.  ( k -  1)' 
k  k  i ,  j  i,  j- 1 


(5  18) 


which  is  the  expression  for  the  average  sequential  likelihood  ratio  for  the  Sporadic  -  Poisson 
generator  process. 

In  this  realization  the  probabilities  b.  k)  must  be  updated  .is  each  unit  observation, 
x^,  is  taken.  In  Chapter  III  the  general  equation  for  updating  information  was  shown  to  be 


Pk(s  iN) 


SS)I{\  * 

flxk  xk-lJ 


(8  23) 


vVe  now  m‘ed  to  put  tins  in  the  lorm  of  the  1^  ^ '  k ■  probabilities  as  m  Eq.  5.  1H. 

Note  that  the  denominator,  f  lx  ^ ■,  is  a  normali/  c  (actor  civen  In  Eq  5  18 

Also,  as  before,  let  f  ( x .  s)  fix  s  ).  As  remarked  earlier,  this  assumption  holds  for 

K  K  K 

problems  ol  signals  m  added  noise.  Expanding  the  sipnal  u  rtnr,  s,  in  terms  ol  its  samples 
permits  Eq.  3  23  to  be  written  as 


,  SN  Pk-ltSr  s2'  •!*kSN,MxkV 

p(s.s  .  ,s.  SM 

K  1  1  K  i  x  X  ) 

k  k-1 


(  3  1  ‘J  I 


Let  us  now  sum  both  sides  of  Kq  6  19  over  tin*  first  k-1  samples  of  the  ith  Component 


c  c  c 

t .  n.  i .  n  i.  n 

l  l  i 


s!  q  0  S  ‘,.0  *Vl  V.O 


WV  "'k  SM 


c .  c .  c 

i,  n.  \ ,  n.  t .  n  . 

i  ,i  i  i)k-isrf,2- 


’k  SN)n\  V 


sc  sc  s  c 

1  i.O  2  1,0  k-l  i,0 


nxk  xk-l 


tf>.  20) 
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Tlu  sequential  avi  ra^i  likelihood  ratio,  (  (x^  j),  is  independent  of  the  summation  over 

the  k-1  sample  values  of  the  signal  so  that  the  denominator  may  be  removed  from  the  sum¬ 
mations.  f  (x  s  ;  is  also  independent  of  the  summations  and  can  be  factored  out.  This  means 
K  K 

that  Eq.  5  20  ca:i  be  written 


c .  c  c . 

i,  n  i,  n.  i ,  n. 

,  i  ,  1  .  1 


sl  Ci,0  s2  Ci,0  Vl  Ci,0 


pk(srs2' 


.  S  SN) 

k 


c .  c .  c 

,,  ,  1,  n.  l,  n.  j  || 

k  _  1  s'...' 

nxk  Xk_I.  Sj  fii0  s2  ct_  0  sk  !  C|  0 


pk- 1  sr s2 . VSN)  (5  21) 


The  lett  hand  side  of  Eq.  5.21  us  by  definition  <>1  marginal  probabilities 


c  c  c 

l .  n  i,  n  i.ii. 

i  i  i 


•S1  C1,0  S2  l’i,0  Vl  C1,0 


pk(W  •skSN)  pk(bk  SN) 


(5  22) 


Ilierelore  Eq.  5  21  becomes 


c .  c 

i.i  i .  n.  i ,  n 

i  i  i 


i  (X  s  I 

k  k 


Pk  sk  SN) 


S1  C'i,  0  S2  ‘V  0  V  1  V  0 


•WVV 


s,  SN) 

k 


(5  23) 


\.r 


As  before,  by  definition  of  a  joint  pi  obabilby .  we  can  wrtU 


pk-i(flr s2'  •  -sk  SN)  pk-i'Vs2'  "Sk-1  SN  pk-i,sklSrs2 . VrSN) 

S  24) 

Now  considerinr,  generator  processes,  which  can  be  expressed  as  a  function  g(s  s  SN), 

K  K  ■*  1 

in  cat  writi  Eq.  5.  24  as 


pk-il‘Vs2'  •  'skSN)  pk-i(rirs2’  ■■•sk-ilSN)R,sk  sk-rSN)  15  25) 


Inserting  this  expression  into  Eq  5.  23  results  in 


42 


Pk(VSN)  = 


c.  c.  c. 

1,11,  1,11.  i,  11. 

f(xklsk)  -  -  •  •  -  Pk- l(sr  s2'  -sk  rSN)^,sklsk-i'SN1 

_  hl  cj,0  b2  Ci,0  Vl  C i ,  0 

f(xk,Xk-l» 


(5  26) 

Since  this  equation  involves  finite  summations,  the  order  of  summation  can  be  interchanged. 
Summing  with  respect  to  s^  ^  first  and  factoring  out  g(s^is^  j.SN)  from  the  summation 
over  the  first  k-2  samples  of  the  signal,  since  it  is  independent  of  that  summation,  results 


in 


i,  n 

i 


l 


i.  n 


i .  n 


i 


f(xk‘  Sk] 


*VSk  SN) 


sk-rSN 

sk-rci, o  si  c i , o  ~s2  V o ;V_2 _lj,  o 

f (X.  X  t) 

k  k- 1 


Pk-l,Sr  s2’ 


•••Vl  SN) 


(5  27) 


Onee  nmrt  by  definition  ol  marginal  probabilities,  tin-  summation  m  the  numerator  over  the 

first  k-2  samples  can  be  wntte  as  p,  ,(s,  ,  SN  Therefore  hu.  5  27  can  be  written  as 

k  - 1  k  - 1 


i .  n 


•  s  ) 
k  k 


Pk,Sk  SV 


V  1  ci.  0 


p(sk  sk-  f  SN,pk  1  sk  1  SN 


(5.  28 


f  V  \  >’ 


insertion  o!  the  generator  proc<  ss,  r;(s  s  .  ,SN),  for  tin  Sporadic  -  Tmsson  pi  ocess  results 

K  K  “  » 

in  a  ii  dm  turn  of  terms  under  the  summation  sine-  only  e  rtam  transitions  are  permitted 
These  properties  wi  ie  previously  defined  by  Kqs  4.  2  through  4  5.  Kquation  5  28  then  t.ikes 
on  thn  •  tiasu  tori  s 


pk,f*k  ‘ 


1 


r 


p,  ,(s  e  SN)  •  p  (s  e  SN) 
k-1  k-1  i,0  k-1  k-1  i,n 

_ _  i 

f,Xk  Xk-l' 


0 


(5  29) 
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*’k(sk  ci,  1  SN) 


[Vl^k-l  C  i ,  0  SN)  ’  pk-l(sk-l  Cj,  n.  SN]r(xk 


f<Xk  Xk-1> 


(5.  30) 


p  ,(s  =c.  .  !SN)((x  Is  =c  ) 

p,  (s.  c  SN)  k~l  k  ».  j- 1 _ k  .  .k _ I. J  _ 

*  k  k  i,  j 


(5.  31) 


'(xk,Xk-l> 


for  j  -  2,  3,  ....  n. 


If  wo  use  tin  b.  ^(k)  notation  as  defined  by  Eq.  5.  16,  Eqs,  5.  29,  5.  30  and  5.  31  become 


(1-‘i'h.0(k-1)  “Yn^1) 

b  (k) - ^ - — 


(5.  32) 


f(xk  \  .1) 


V . 

i 


>V  I,k;  ’ 


bi.0lK-"  •  l>i.„.,k-,>]'lkk  “k  Vl> 


(5.  33) 


"•*k  Xk-1> 


b.  ( k) 
t-  J 


bi.j-i(k~l)r(xk  -sk  S.j’ 


f(\  Vi! 


(5.  34) 


for  t  2,  3, ....  n. 

‘  i 


5.  1  2  Operation  of  the  Adaptive  Receiver  Tin  basic  equations  of  Realization  I  for 
thi  Sp  radio -Eoissoo  l  ime  Structure  are  summarized  in  Table  5.  1.  These  equations  can  be 
interpreted  b>  e<  sidermp  a  simplified,  illustrative  example.  Suppose  there  are  two  possible 

JO 

components,  i  and  <  “  each  with  three  possible  sample  values;  i  e  ,  b  2  and  n^  n^  3. 

'I able  5  2  summai  izes  the  receni  i  design  equations  for  the  example 
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TAHl  L  1 

BASIC  RECEIVER  DESK.N  EOLATIONS.  SPORADIC  POISSON  TIM  1  STRl'CTIRI 

REALIZATION  I 


Optimum  Detection  Output 


f(Xk’  r,xk-.,f(W-i 


(3.  HI 


Sequential  Avt  ra^i  Likelihood  Ratio 


ftXk  Xk-1 


I  C 


— 

- 

— 

h  ..(  k  -  1 )  •  1)  (k  1) 

i .  0  in 

L  i  -J 

1  -i 

i 

•  ‘  f(\  -SL. 

i  k  k  i 

1» 

h  (k  liMx  s  c  ) 
i  ■  J  - 1  k  k  i .  i 


(5.  18) 


Classiheation  -  C<imp< ..lent  I<|i  nlincation  ami  RiiSUpui 


'Yok 


[' 


1  )  t>  ik  1  •  I)  ik- 

i  i.O  i .  n 
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Vi 


if.  :i2 


b  ,  ( k) 

i .  1 


1)  , ,(k- 1)  •  I)  i  k-  1)  ((.\.  s.  t  ) 


1.0  i,i 


k  ‘  k  i  1 


'  \  XK  I 


(5  33: 


l>  (k) 
i.  J 


,VL-i(k-,’f(xk  -sk  c.iJ» 

f,xk  xk  1 


15  34) 


lor  j  2.3.  ,n 


Classification  -  Component  Idem ification 


|).(C  iSN)  b.  (k) 

K  r o  '■  J 


(5  35) 


I  AH!  1 


I . .  I  (  SI  HA  I  I VF  F.XAMPLF  OF  1IIF  HASH  FQIAMONS 
S  I ’OH  A  1)IC  -  I'OISSON  TIN''  SIRl  t  ITKF 
HFA!  IZA  IION  I 


Ojilimuin  Detection  Output 


(IX  )  (X  ((x,  X,  ) 
k  k  -  1  k  k  -  I 


Sequt  lit  la  1  Avera^t  I  ikeliliood  H a 1 1 < 


n\  Vl* 


b,  (k-  1  •  b  Ok  1) 


1  *  [|_*  1 .  O'  "  "  "\  3 . |  ‘l'~k  “k 


1 1  -i  ,  -  I),  ,(k- 1)  •  b,  ,(k- 1)  i,  Ox,  v  c 


) 


’l.l(k‘1:nXk  \  *  1 ,  2*  •  ‘’l.  2(k"  U  f<Xk  \  Cl.  3} 


t>2  0< k - 1 )  •  l>2  ,((k- 1) 


I  l-i  9) 


k  - 17| 


0 1  k - 1  ‘  h2,  3<k‘ 11  ‘  2f<Xk  Sk 


'  b2.  |(k-1,,,xk  \  1  2.  2*  •  b2.2,k  l’nxk  sk  1  2, 3* 


Olassiltcation  -  Component  Ident  ific.it  ion  and  Position 


Vo"0 
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l)j  ^(k-  1)  •  b  ^(k  1) 

"v  V,1 


( 1  -i, ) 


>'l  0(k 

\,!k) 


11  '  ']  i‘  \  \  c 


1,  1 


f(Xk  Xk-1> 


b  (k-l,f(x  s  c  ) 

b  (k!  — — —  ■  k  l*2 

f'XkIXk-,' 


bl,3/k) 


bl,  2(k ~1);(xklsk  Cl,3) 
f(xkIXk-l> 


(3  H) 


(5  3H 


(5  37) 


(5.  33) 


i  5,  39) 


(5  30) 
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b2.0(k) 


[' 


b2yk-n  ♦  b2  3(k-i) 

f(xk‘ Xk-1* 


( *  - 1  2 ) 


(5  41) 


b2.  l(k) 


bo  oik-D  <  I>„ 


L‘iJ2,0 .  ' 


3U''3  V'Xk  Sk  1  2, 


f,Xk  Xk-l' 


(5.  42) 


b2,2'k) 


b2.1(k~lir<XkISk  (~  2 ,  2  1 

nVXk-l' 


5  43) 


b  (k-l)Mx  s  c  ) 

b0  (k)  ^  J  - 

(,Vxk-.> 


(5  44) 


Classification  -  Component  Klcat ificalion 


r  1  o. 


Pk<C  SN)  0^  y(k)  ■  t)j  j ( k )  •  b(  9(k)  •  bj  ,((k) 


(5  45) 


Pk(C2  SN)  b0  0tk)  •  b2  j ( k)  ♦  1>2  2<k)  •  b^  ^tk) 


(5  46) 


Kach  term  iii  the  sum  of  Kq.  5.  36  and  each  numerator  oi  Kqs  5.  37  through  5  44  is 

«lie  product  of  three  basic  factors  One  factor  ;s  .i  probability  or  combination  of  probabilities 

of  the  b  ^(k-  1)  type  Thesi  probabilities  c  -.in  .ill  past  information  relevant  to  the  optimum 

detection.  The  second  factor  a  probability  associated  with  the  generator  process  which  is 

l-i.,  l-i  or  1  l  In  third  (actor  is  a  likelihood  ratio  term,  fix,  s.  c  )  This 
13  1  2  k  k  i .  j 

is  tin  factor  which  extracts  tin  proper  new  information  from  the  unit  observation,  x  In 

K 

addition,  a  normalizing  factor,  f(xk  Xk  j),  appears  in  the  denominator  of  taps.  5.37  through 
5.  44.  In  kip  5.  2.  the  sequential  quantities  tiiat  are  calculated  are  represented  on  a  time  axis 


Tie  b  (k-1)  terms  relate  to  the  time  just  prior  to  the  kth  observation.  The  probability 
1  •  J 

associated  with  the  venerator  process  is  combined  with  the  b  (k)  terms  to  obtain  an 

i.  J 

a  priori  probability  about  what  will  occur  durmp  the  observation  x  .  These  are  combined 

K 

with  a  fix.  s,  c  )  term  to  vet  f(X,  )  and  a  new  set  of  b.  (k)  terms 
k  k  i.  j  k  i,  j 
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that  component  C  has  been  selei  ted  but  is  cither  off,  c  j  or  at  its  last  component  sampli 

Cj  ^  at  time  t  j  This  is  multiplied  by  the  probability,  l-i  j  that  the  component  will  not 

start  at  time  t^  undei  the  condition  component  C  '  has  been  selected  This  is  then  multiplied 

by  the  likt  liliood  ratio  of  the  kth  observation  it  the  comp . .  t  C  '  had  In  en  selected  but  is  oft 

at  lime  t,  This  likelihood  ratio  has  the  value  out 
k 

The  interpretation  o!  the  second  term  in  the  sum  ol  hq  5  36  is  that 

(1/  _  1  Tl  .  t  I  li , 


\u,k  ’  1 


lhlhtliM  I  fl  IT  1/  -  1  nlim 


that  component  C  has  In  i  i 


selected  and  will  start  at  time  t  This  probability  is  multiplied  by  the  likelihood  ratio  of  tin 

K 

kth  observation  if  t fit  first  sampli  of  tin  cmnpo  « -nt  C  .  which  is  Cj  ^  is  present  at  turn  t 
In  the  third  term  of  hq  5.36,  b^  .  ( k - 1 )  is  the  probability  after  k  1  observations 
tlint  the  first  sampli  of  component  C  *  denoted  by  e.  ^  was  present  .it  time  t ^  j  Also 
hidden  is  a  lactor  of  one  which  is  the  probability  that  the  second  sample  of  component  C’^. 
c  occurs  at  time  t,  if  tin  first  sample  of  component  C*.  c  .  occurred  at  turn  t 

i  c.  K  i  l  K  ‘  1 

This  is  then  multiplied  by  the  likelihood  ratio  f(\^  s^  i  ^  0).  of  he  obsi  rvation,  x  This  is 
tin  likelihood  ratio  of  s^  had  the  second  sample,  c  ^ .  of  component  C  occurred  at  time  t^ 

The  interpretation  of  the  fourth,  term  of  hq.  a  36  is  analapous  to  that  of  tin  third 
term  The  fifth  through  eiphth  ti  mis  n  fer  to  component  C^,  and  then  inti  rpn  tation  is 
analapous  to  that  of  the  first  four  tt  rms  The  reader  will  notice  that  terms  of  hq  5  36 
appear  individually  in  the  numerators  of  Kqs  5.  37  through  5.  44  The  denominator,  f  (x  ). 

is  a  normalizinp  factor  All  eipht  probabilities  1^  yk)  could  be  displayed  as  a  classification 
output,  but  it  is  more  likely  that  the  only  information  wanted  is  which  of  the  two  components 
is  presented.  The  component  identification  output,  which  can  In  displayed  is  pi  veil  by 
hqs  5.  45  and  5.  46  m  Tablt  5  2 

In  hip.  5.  4  a  block  diagram  of  Realization  I  is  shown  for  the  general  case.  This 
receiver  operates  sequent. aliv  in  turn  ,  extracting  and  updating  information  after  each 
sample  of  the  obsi  rvation,  ,\  T  wo  outputs  art  provided  sequentially  in  time.  Om  is  tin 

logarithm  of  the  likelihood  ratio  from  time  zero  to  turn  t  which  is  f,if(X  ),  tin  detection 

K  K 

output.  This  output  is  used  to  decide  presence  or  absence  of  recurrence  phenomenon  in  the 
interval  (0. t^h  Tin  other  output  is  the  classification  output,  p  (C1  S\).  This  output  provides 
information,  in  t hit  form  of  updated  probabilities,  as  to  which  component  has  been  recurrent 
from  time  zero  to  turn'  t, 
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Tht  summer  si  (ires  a  number  which  represents  tile  logarithm  of  tin  likelihood  ratio 

of  the  observation  X  When  the  next  observation,  x  is  made,  the  possible  component 

K  *  1  K 

waveform  samples,  e  ,  stored  in  fixed  memory  art  used  to  form  the  likelihood  ratio  ol  (lit 
>.  J 

kth  observation  for  each  of  the  possible  components  and  component  positions  I'ht  st  individual 
likelihood  ratios  are  weighted  by  the  updated  probabilities  of  t lit  various  components  nil 
component  positions  which  are  stored  in  tilt  temporary  memory  and  which  art  the  result  ol 
combining  initial  knowledge  and  information  from  llit  observation.  X  j  This  weighting  is 
performed  in  the  t'ox  labeled  !h(.\  X  ),  The  t>ut|iut  ol  this  box  is  added  to  fnf(X  ), 

K  K  1  K  “  1 

which  is  already  in  the  summer  to  lor  m  <  n  f  ( X  ) ,  t  he  detection  output  oyer  (0,  t  '  '1  his  <  -ut  put 

K  K 

is  compared  with  a  threshold  to  provide  a  yes  -  no  dt  cisioe. 


Simultaneously,  information  ironi  the  observation,  x^,  as  provided  at  the  output  of 
the  average  likelihood  ratio  box  is  combined  with  classification  information  from  the  obseiva 
lions,  X^  j,  in  the  probability  updater.  The  probability  up'later  performs  the  operations 
specified  by  Kqs.  5,  32  through  5  3-4  The  updated  probabihMes,  b  ^ ( k ) ,  replan  b^  (  k -  1) 
m  the  temporary  memory,  and  the  receiver  is  ready  to  accept  the  k-1  observation.  A 
classification  output  could  In  taken  directly  from  the  temporary  memory  it  is  more  likely 
that  a  display  ol  tin  updated  probabilities,  p  (C1  SN).  b.cj  5  35  in  Table  5  1,  is  wanted  and 

K 

th.s  can  be  obtained  by  summing  1^  ^(k)  o>  <  r  ill  j 


5.  1,  3  Other  Hcrcivci  Idealizations  and  the  I’se  of  Memory.  In  Section  5.  1.  1,  a 
"eali/ation  of  tilt  optimum  recent  r  lor  a  sporadic  -  recurrent  component  is  presented 
Although  the  receiver  realization  discussed  here  was  obtained  by  lormai  manipul.d  ions  ol  a 
likelihood  ratio  equation,  its  n.iturt  is  intuitively  satisfying.  It  uses  each  observation,  x 

K 

to  learn'  as  much  as  possible  whit  h  component  is  present  This  inlormation  is  stori  1  in 
the  form  of  the  b  (k)  matrix  i  t  f  it  •  temporary  memory  This  knowledge  is  kept  current  by 
combining  know  ledgt  of  the  gent  rat  or  p  rot  ess,  the  ml  or  mat  i  on  e.  mtai  ned  in  all  pi  evious 
observations,  and  information  obtained  in  the  kth  observation  As  time  progresses,  this 
ret  t  ivef  adapts  to  tin  particular  component  waveshape  that  is  recurrent,  and  it  "adapts 
locally  to  position  withn  .t  component 
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In  this  r»  ah /at  inn  b  (k  1)  must  bn  kept  up  to  date  as  each  observation  is  taken, 
l.  J 

I  best  probabilities  express  up-to-date  knowledge  on  which  component  is  present  as  well  as 

component  positional  information.  Although  the  leftover  takes  into  account  all  the  possible 

turn  patterns  ol  components.  iis  memory  need  not  store  all  of  these  patterns  Realization  I 

b 

has  a  temporary  memory  which  is  continually  updated  and  which  has  a  finite  size  of 


words  1  Ins  finite  memory  i.->  a  primary  practical  feature  of  this  realization. 

Realization  I  is  not  unique  In  Appendix  A,  three  other  realizations  of  tin  optimum 

receiver  are  presented  Realization  II  (see  Appendix  A  1)  is  similar  to  Realization  I  except 

lor  the  (act  'hat  information  about  component  identification  and  component  position  are 

updated  separately.  Therefore,  Realization  f!  requires  a  finite-size  temporary  memory  of 
I) 

n  words  for  component  positional  information  and  b  words  for  component  identifcatmn 

i  1  ‘ 


ii. formation. 

Another  receiver  realization  is  Realizatioi  III  (see  Appendix  A  2).  This  is  a 
recent  r  which  has  a  channel  tor  each  of  the  b  possible  components,  l-.ach  channel  calculates 
the  likelihood  ratio  of  the  observation  conditional  to  presence  of  the  ith  component  and  the 
channel  outputs  art  then  weighted  by  the  a  jinori  probabilities,  p  (C*  SN).  of  the  selection 
oi  each  of  the  components,  and  then  summed  This  receiver  looks  less  adaptive"  since 


p  (C  SN)  is  not  explicitly  updated  at  each  step  in  time  n  words  of  temporary  memory 

i  1  ' 

arc  needed  to  store  component  identification  information  and  positional  information  and  b 


words  to  st on  f ( X ,  C  )  terms, 
k 

An  important  practical  realization  is  Realization  IV  (see  Appendix  A.  3).  It  is  a 

b-chaniicl  receiver  that  appears  to  require  the  least  number  of  computations  of  the  four 

realization  presented  The  basic  design  equations  are  summar.zed  in  Table  5  3  and  a 

block  diagram  is  shown  in  Fig.  5.  5  By  comparing  Table  5  3  with  Table  5  1  one  can  see 

the  simplificati  >n  m  computations  of  Realization  IV  In  this  realization  a  quantity 

Q  ( k ;  f(X.  )b  (k),  instead  of  I)  (k),  is  stored  in  temporary  memory  for  each  possible 
l .  J  K  1  .  )  I  J  b  • 

component  and  component  position.  A  linite-sizi  memory  of  n^  words  is  needed  to  store 

tlu  ^(k)  terms  The  updating  equations  for  tin  Q  ^ ( k )  terms  are.  however,  simpler  than 

thosi  required  for  tin  b  (k  terms  in  Realization  I.  More  or,  in  Realization  IV,  the 

!•  J 

likelihood  ratio  is  calculated  b\  simple  addition  of  the  Q  (k)  terms  and  the  classification 

i.  J 


output  is  obtained  almost  as  simply 
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I  Aim  5.  3 
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Figures  5  0  and  5  7  show  a  more  detailed  block  diagram  of  Iteali/atioi  IV  for  signals 
in  added  while  (.aussian  noise  Figure  5  6  shows  one  channel  ol  the  Mist  portion  of  the 
rtceiver  which  computes  (iX^)p^(C1  SN)  Fach  channels  only  looks  for  tin  ith  component 
taking  into  account  .ill  possible  time  patti  rus  of  that  component.  Figure  5.  7  shows  how  each 
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I  these  dim  u'l  outputs  .ire  combined  to  form  the  detection  and  cla. .sification  outputs.  This 
realization  uses  tin  logarithm  of  taps.  A  35  through  A.  37.  New  information  obtained  in  the 
unit  obsc  rvation,  x^  is  combined  w  ith  information  obtained  from  pr<  vious  observations  in  the 
st  nes  of  adders  shown  to  the  left  of  the  delays  where  ~  j  is  the  smallest  possible  time 
shift  on  a  component  Tht  unit  observation,  x  is  first  processed  to  determine  how  likely 
it  arost  from  the  various  possible  positions  of  the  tth  component.  Tfiis  processing  consists 


of  correlating  x,  with  each  of  tfie  possible  positions  that  a  component  could  be  in  and  adding 

K 

2 

bias  tt  rms,  fnij  -  c^  ^  2  I  hese  ouiputs  are  then  applied  to  a  series  of  adders,  each 

•separated  by  a  Tj  delay.  The  outputs  of  these  adders  are  t lit*  logarithms  of  the  Q.  k)  terms 

which  contain  all  the  information  about  the*  likelihood  of  the  jth  position  of  the  itli  component 

being  present  during  the  kt h  observation.  These  terms  are  summed  over  j  giving  the  likelihood 

that  the  i t  h  component  has  been  recurrent.  As  one  can  see  from  Eq  A.  37,  the  Q  f k)  term 

i.  J 

is  obtained  at  time  I  and  U  is  calculated  from  a  similar  quantity.  Q.  (k-1),  at  time  t,  . . 

k  i.  j  k- 1 


I'lu 


j  d.  lays  provide  the  memory  delay  for  this  computation  The  "trip"  on  the  far  left  in 


l  ip  5  G  lalcuiates  Q  .  Ik)  •  Q  !k>  alone  with  its  logarithm  which  is  used  to  make  the 
i,u  i.n 


;  ori’pi  fations  specified  by  Eqs.  A  35  and  A.  3G 

The  output,  f t X  C' 1 ) p  < C' 1  SN),  becomes  one  of  the  inputs  to  the  remainder  of  the 

K  K 

receiver  shown  m  Fig.  5  7  The  detection  output,  fnffX  ),  is  obtained  by  summing  the 
terms.  ((X  c')p,  ( C 1  SN)  of  the  t)  channe  ls  The  classification  outputs  are  obtained  by 

K  K 

taking  logarithms  of  f ( X  c'lp  <c'  SN)  for  each  channel  and  subtracting  tfie  logarithm  of  the 

K  K 

det .  c  lion  i  iiitput ,  f  u  f( 

Figure  5.  H  shows  another  version  of  one  of  the  input  channels,  which  could  be  used 
bi  place  of  the  realization  shown  in  Fig  5  6.  ft  is  quite  similar  except  it  Implements 
I-.qs  A.  35  through  A  37  direc  tly,  rathe  r  'ban  the  logarithm  of  these  equations.  Ar  a  result 
somt  of  (tie  adders  must  be  replaced  by  multiplied  s 

7  he  important  feature  m  common  to  ail  lour  realizations  is  the  fact  that  the  size 
of  tht  temporary  memory  remains  fixed  and  slides  in  time.  This  is  of  practical  importance 
not  only  for  receiver  design  i.ut  also  for  receiver  evaluation,  A  nonsequential  realization 
would  have  requited  a  growing  memory  Such  a  realization  is  impractical  to  bund  A 
receive!  must  be  designed  before  it  can  be  evaluated,  the  sequential  or  adaptive  realizations 
uovide  simpler  expressions  to  work  with. 


Fig.  5.  8.  Ada 
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5s  2  Optimum  Adaptive  Receiver  Design.  Synchronous  -  Pnisvni  Turn  Structure 

In  this  section  an  adapt ivt  realization  ol  the  optimum  recener  is  presented  for 
detecting  signals  with  a  Synchronous  -  Poisson  lime  Structure.  Tins  time  structure  provides 
interesting  cases  in  that  the  amount  of  time  unit  rtan  tv  is  between  tin  periodic  and  sporadic 
time  processes.  The  uncertainty  is  in  the  exact  component  wavelorm  t  runsm  itt  t  d  and  i  tin 
component  recurrence  times  associated  will  the  Synchronous- Poisson  Tiint  St  ructun  One 
of  the  h  components  is  selected  for  transmission  and  tin  sunn  component  recurs  throughout 
a  total  obser cation,  X  .  Primarily  for  comei.it  nee  and  simplicity,  11  is  assumed  that  all 
components  in  the  ftmti  ensemble  at  e  of  common  duration  and  the  possible  starting  tin  is  of 
a  component  are  known 

Due  to  the  synchronous  nature  of  tin*  time  structure,  then  is  no  pos  it  i  one  I  uncci  la  i  lit  v 

of  components  lilt  it  lore,  tin  c  impon-  t.t  samples  can  lit  combined  into  one  stait  Thus 

C  ,,  U  ,, .  c  ,,,  .  c  ,,  i  ttm  st  :  is  absence  and  ,  'c  ,  ...  t  )  rt  pn  scuts 

i.O  i .  0  i  0  i  0  i.l  i  1  i ,  2  I  ' 

i 

presence  of  1  la  it h  compel  enl  Tin  piobubili  \  o|  triggering  a  t  ompoi.enl  conditional  1  i 
selection  of  the  ith  eompoi  tut  is  ,  The  slate  diagram  lor  tin  ith  n  mponenl  has  been  shown 
in  1 ig  1  5 

The  basit  st<  ps  in  the  devt  iopment  of  tin  rurnri  real  i.’at  m  hi  for  detecting  signals 
with  tin  nr  hronous  -  Poisson  lime  Structure  began  with  steps  1-3,  gnen  on  pagt  35  !n  this 
section  the  propt  rtits  ol  the  signal  for  lilt  Synchronous  Poisson  Time  strut  lure  are  combined 
with  Tqs  3  H,  3  22  and  3  23  to  obtain  tin  adaptive  reieivi  r 

5.2.  1  Sync  In  minus  -  Poisson  Timt  Structure,  Heali/ation  I  In  the  Synchronous  - 

Poisson  case,  component  position  is  known  exactly,  but  whethet  a  component  is  pi  esent  or 

not  is  uncertain.  Therefor  t  tin  recent  r  can  operati  sequt ntiallv  in  time  blocks  equal  to  a 

component  duration  In  this  section  \  l  ->  an  n  -dimensional  observation  having  tin  duralni 

ol  a  component  and  S,  is  an  n  -dimensional  segment  ol  tin  sigi  al.  s  S,  S...  S  .  which  is 

'  k  i  12k 

eitln  r  tin  iih  ret  Ji  l  t  nee  phenomenon  with  tin  comiionent  on  (  ,  or  tin  ith  recur  relict 

i.l 

phenomenon  with  the  component  off  (  ^  With  this  changt  in  the  notation,  tin  sequential 

average  likelihood  ratio  anaiagous  to  hq.  5.  2  is 


(<Xk  Xk-l’  'IXk  S)|,k-1 
st  S 


(s  SNl 


(5.  47| 
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The  signal  ensemblt  space.  S,  c  an  be  partitioned  into  b  disjoint  subspaces,  S  Patch  S 
subspace  cniita'iis  all  those  signals  that  might  result  from  the  ith  component  alone.  This  is 
a  result  ol  tin  rest  mime.  tha!  a  given  component.  C1,  is  selected  and  fixed  at  the  beginning 
of  each  long  transmission.  Thus  P.q  5  47  can  be  written  as 


"WT  ,  I  CI.SMIV,IC'  SM 

i  1  s>  S( 


l  5.  48) 


P.xpu tiding  the  vector,  s.  into  sample  lurm.  Fq  5.  48  becomes 


b 


c  c  c 

1.1  1.1  1 . 


V,1  -.  s  ..  ••  ..  %  W  Y 

1  i.02  i  0  k  i  0 


Vl'W  ,  l  SN'’k  l,(  l  SN) 


(5  49) 


Since  s  is  tin  recent  I  input  it  tin  re  were  no  noise 


fix,  S  .  S  .  ,  S  )  t(x  S  ) 

k  1  2  k  k  k 


(5.  50) 


Due  to  the  independence  of  the  signal  recurrence  (see  page  30)  we  write 


P,  . su  C.SN)  I v/VV  Vl  C‘SNX-i(Si,  C‘'SN)  <5  51) 


k- 1  k 


Substitution  of  P.qs  5.  50  and  5.  51  into  Kq.  5.  49  results  in 


((xk  -Vi! 


c  1  C  1  c 
1.1  1.1  1.1 


i  1  s.  c  s_  c  s,  c 

1  i.O  2  i,0  k  i.O 


,,xk  W-llSV*2 . Vl  C''SN) 


Vl,Sk  C*.  SN)pk_  j(C*  SN) 


(5.  52) 


Since  we  art  dealing  with  finite  sums,  the  order  of  summation  can  be  interchanged.  Re¬ 
ordering  the  summations  and  factoring,  fctq.  5.  52  can  be  put  in  the  form 
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,l*k  \-l) 


i  I 


Vi,c  sn» 


t.  1 


Sk  (  i.O 


,,xk  V'>k  .(Sk  r’-SN 


S, .  c,  1 


I.  1 


bl  (  i.  0  S2  (  1.0  V  1  i.  0 


';i< - :  Si  S:>  •Sk-i<-  -SN 


;  i  r>.  Dv 


whcrt'  tile  it  !'m  in  brackets  is  equal  to  one  Then  Ion 


SN)  j^< 


.1  .  . 


"\  Vi1  .  "o"  SSI  "\  \  NV'k-l'N  N.o  1  ss 


•  I  ... 


f(xk  sk  c,.i,1'k-i(Sk  S.  1  (  SN’ 


I  6.  6-1 


My  definition  of  the  signal  generator  profess  considered  here.  (i.qs.  4.7  and  4.  Hi, 

P,  ,(S,  C  C1.  SN)  1  and;;,  .IS,  C  ,  (.'.SN  Also  lor  /eru  eiirrn  supials  in 

k  1  k  i.O  i  k  -  1  k  . .  1  i 

added  noise.  f(.\,  S.  (  ,1  1  VS  c  t  an  then  put  hq.  5.64  m  its  final  lorni. 

k  k  i ,  0 


Vi1  Or-i11'  SN1'1-  '  '  s-  1  •  1 

1  1 


i  i  k  k  i . 
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It  is  also  necessary  to  obtain  equations  that  update  winch  component  is  beinp 
transmitted  The  updating  equation  is 


p  (  s  SN ) 

K 


nxk  M,,k  i,h  SN 

V. 


(5.  25) 


Usmp,  the  definition  of  condition.il  probabilities,  this  equation  can  be  written  as 


An  expression  similar  to  hq.  5.  55  with  b  1  i  which  cast  p^  j ( C ’ '  SN)  1  arost  from  a 

Synchronous -Poisson  tripper  process  in  the  piper,  "A  Sequential  Test  for  Radar  Detection 
of  Multiple  Targets.  "  W.  R.  Kendall  and  I.  S.  Heed,  IRK  Trans  on  Information  Theory, 
Vol.  IT-9,  .January,  1963. 
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Pk(.s  c'.SM^lC1  SN) 


ro:k  s)|Vl(s;cl,SN)l>k-1(Cl  SN) 
nxk  xk-l' 


(5.  56) 


Writing  s  in  sample  I c ii- in  and  .summing  both  .salt  s  of  Kq.  5.  56  over  all  possible  signals  for 
tin  i!h  component  gives 


i.l  .1  i.l 

iy<-''  ^  ()klSi  s'> . sk  (;'-SN) 

K  S(  s  C  S  ( ‘  K  1  z  K 

[_l  i.O  2  1.0  k  i.O 
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,  .1  ...  k  I.o  1  i.O  2  I.  0  1  1.0 

P  c  SM-  -  -  -  -  -  - 

f,\xk.l* 

(5.  57) 


I  In  bint  ki  ted  It  i  ms  on  rath  sulr  of  Kq.  5.  57  art  equal  loom  so  that  we  hast 


[('K  K  (;.  o>lV.,!y  n  c'.SN)  •  «>„  S„  C,  ,)!)„.  t(S„  C  ,  C1,  SN) 


p  SN,  p,  l  C1  SN  l  k  K  k‘‘  k  l'° 

l{\  \  ,> 

k  k- 1 


k  k  i.  1  k- 1  k  i,l 


(5.  58) 


Iht  terms  in  brackets  in  the  numerator  of  Kq.  5.58  become,  as  before,  l-i  <  r  f(x  ,  S,  C 

i  i  k  k  t.  1 


I  hi  updating  equation  (or  compoi  ent  i  id  or  ma  t  ion  is 


-Vc'  SNI 


1  ,  •  ,%  \  Nijvi11'1  SN1 

Msk  i’ 


& 


(5  591 


(-.qualities  5.  55  and  5.  59  art  the  basic  equations  for  the  adaptive  realization.  Defining  the 
component  conditional  sequential  likelihood  ratio  as 


fix.  X,  ,  .  el  I-,  •  ,  fix.  S  C  ,) 

k  k- 1  i  i  k  k  i ,  1 


(5  60) 


Classification  Display  p,  (CM 
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t  c  a  pul  K(|.  5  5f>  '.••to  tin  (urn: 
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Component  Ci  mill  t  it  >ii.i  I  Sequent  iu  1  lulu  1 1 hood  Hallo 


((  X  C  )  l-i  •  i  dx  S  C 
k  k  -  1  i  i  k  k  i .  1 


(5  60) 


Clus.silu'ulion  -  Component  Identilieation 


I),  , '  C  '  SMfix,  X,  ,  ,  C1! 

[)  (C*  SN)  'k-'  k  R-' 

fL\  Xk.l' 


(5.  62) 
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5.  2.  1 Operation  ol  tlu  Adaptive  Receiver.  hipurt  5.9  is  ,i  block  diagram  n( 

Realization  I  tor  components  in  added  white  Cau-ssiai  muse.  In  this  ea  se 


\  (  i.  1 


t  ,  C  . 
i.l  i,l 


nw,.i  * 


(5  03) 


when  3.  the  noise  pnw  er  i  n  t  he  rect  i  v  t  r  ha  ndw  idt  h.  is  me  I  In  receivei  input .  \  is 

correlated  with  each  pnssiblt  component  tli.it  could  occur,  and  the  bias  (  •  (  ,  2 

i.l  i.l 

subtracted.  Thesi  outputs  an  thei  passed  through  a  nonlinearity. 


\  L  l.  1 


C  .  C  . 
i,l  i.l 


(•  fi\  x  i •  (  i  fi-Si  ♦  •  ♦ 

k  k- 1  li 


t 


1 


j 
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This  nonlinearity  depends  on  tlu  tripper  probability  .  .  which  is  also  the  duty  (actor  in  'In 
Sync  hr  oiii  ius  -  Poisso  li  no  St  r  uct  ur  t  I  his  non  I  u  ea  r  1 1  y  is  ca  i  led  ;  lie  .  non  1 1  nt  a  r  1 1  y  Oi  i 
could  wi  '•  (his  equatio'  words  as  (  X  ^  I  ^  liki  lihood  ratio  ol  pive  tin 


( I  iki  lihoi  id  rat  mo!  y 
i  k 


seleetmi.  ol  tin  it h  compoi  ent  but  no  roinponent  occurrentt 
p  i  v  i  t  he  st  1 1  ct  i  on  ol  t  he  1 1  h  c  oinponent  and  i  ompoi  ;t  nt  oct  u  r  relict  t  I'll  us  ,  I  in  i  i  kt  li  hood 


ratio  ol  tin  olis  erv  at  io:  \  ,  is  i  oni  puted  as  i  I  a  compont  nt  oct  uri  ed  a  nil  tins  is  watered 

k 

dow  i  because  ol  l  he  r  ec  u  i  r  e  i  u  t  unt  t  rial  i  ,t  \  I  lpu rt  5  1  {)  s  In  iw  s  a  pi  nt  ol  t  In  non  1 1  nt  a  r  1 1  \ 
I  i  s  t  \ t  ra I  v  a  I  ut  s  ol  . 


llu  outputs  o|  tin  st  nonlu  t  ai  do  s  (\  X  ,  (  ait  linn  weighted  by  updated 

K  K  » 

k  i  1  e  lpe .  p  if'  S.N  a  s  I  o  w  hit  h  compoit  lit  ,s  In  i  np  st  I  I  lus  tor  ins  t  In  st 'i|ut  I  i.i  I 

avtiapt  liktl  hood  ratio,  fix  X  w  hit  h  is  combn  <  t  with  ft  X  topiovidt  tin  delectini 

k  k  1  k  -  l 

output  I  (  X^ 

I  lie  r  i  cel  vt  r  also  updates  p  ,!(  *  S  V  .  tin  cntupni  e'  t  information,  toplC1  S  M  a  d 

K  ~  1  K 

stoles  thesi  updated  pt  obabi  I  it  ics  n  preparation  (o'  the  next  olist  i  vation.  Idlest  probabilities 
can  In  read  out  to  lorm  a  classifit  ation  output. 


5  2  3  Other  Receiver  Realizations  and  tlu  I'se  of  Memory'  In  Sect  mi  6  2  1,  a 
realization  ol  tin  optimum  n  i  t  ty  t  r  for  a  synchronous  -  recurrent  component  is  pn  sented 
Reahzalioi  I  has  a  temporary  memory  which  is  continually  updated  and  winch  has  a  Iinite 
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Mi't  ■  i)l  I)  w  ord.s.  Although  tin  receiver  takes  n. to  aeenuiil  all  the  possihlt  turn  patterns  of 
components  its  memory  need  mil  slur a  all  nl  tlnst  patti  ms  I  his  (mite  mem  r\  is  a 
primary  praitie.il  leutun  n(  this  re.i li /at 1 1 .1  . 

I  wi  1  ot In  1  rea  1 1  /at  1 1  ins  1  il  the  t ipt  1  mu m  ret  em  i  a  1  e  dt  1  1  v  rd  in  A p p «  1  \  It . 

Heali/atim;  III  (see  App<  ndix  I!  1  is  .1  I)  -  e  Iran  1  al  recent  r.  I  lit  likelihood  ratio  el  tilt 
(ibservatim  conditional  In  present  e  of  ea.linl  llu  b  n  impel  lent  s  is  computed  sequt  lit  la  IK 
11  separate  elum  ids  and  the  outputs  art  weighted  b>  tin  a  pri  hi  probabilities,  1  (  1  SN  . 
nl  the  select  1 1  in  1 1!  eat  h  ol  the  t  1  mi  pi  n  tents  and  then  suiiimi'il.  I  this  rt  1  eu.  r  b  w  ,  irds  1  if 
meuuirs  are  needed  I  stun  tin  likelihood  ratios.  ( 1  X  (  ' 

K 

Heali/atmii  IV  is  an  important  prat  Heal  ret  river  since  it  appt  ars  hi  lit  tin  simplest 
(see  Appendix  B  2i  rile  basic  desinn  ii|uatimis  are  suiiimaii/id  in  Iable  5  a  and  .1  block 

diag ra m  1  s  show  1  1 1  lip.  all  I  his  is  a  b-rlu  1  1  1  •  c  t  1  v  t  1  i  hi  1!  h  i  ha  i  1  t  1  c  or  1 1  1  at  t  s 

TABLh  a  f> 

BASK  IllCH  VI-  H  ill-  SH,N  KM  A  1  IONS.  SYNC  HHONOIS  POISSON  I  IM  I-  SIBlt  II  I U 

HKA1.I/AI  ION  !\ 

Opt  1  nn  m  I )t  1 1  ct it  11  Output 

b 

(X  0  '■  k  B  I  (l 

k  ,  1  1 

1  ,!  ni  mat  it  n.  I'pd.it  1  i.c 

r  ~i 

y  k>  0  <k  !  !  1  •  .  (<\ ,  si  C  ,  B  17 

1  1  1  1  k  k  1.  1 

C  lasstl  it  at  it  in  Oomponi  iit  hit  nt  il  it  at  im 

y  k 

*V(  '  SN>  t'xL  H  2"’ 

K 

t  lit  input  with  tin  1 1  h  comp  .  it  .mil  subt  rat  t  s  a  bias  trim  0 1  t  1  2  hills  quantity  is  then 

led  1  it  o  a  .  in  in  1 1 1  m  a  r  1 1  v  to  1  u  m  y  !  k  1 .  The  y  (  k  It  1  ms  art  stored  and  accumulated  1  1  each 

1  1 

d  tin  cniiipni  t  nts  b\  means  ol  tin  1  haunt  I  adders  and  tin  T  del.ns  I  In  st  terms  art 
1  Apt  11  t  iitiateii,  summed  a  al  tin  logarithm  lormed  h  the  detectton  output  I  ne 


classification  output  is  obtained  by  -subtracting  fnffX  )  Irom  tin  output  'I  each  o|  tin  i  ecu 
culating  delays.  Hy  comparing  labit  5.  3  with  Tabl  5  -1  «mt  c.n  set  the  simplification  n, 
computation  of  ReaP/ation  IV.  In  this  icali/ation  l>  words  of  memory  .in  ret)uired  to  stole 
Q(k)  f(X  )p (C1  b'N)  in  temporary  mimory. 

I  K  K 

I’lle  receivers  presented  in  Section  5  2  are  dilfei  ei  t  re.  i  ll/at  ions  o|  the  optimum 
r  eci‘1  ver .  Tin  pa  r  ticula  r  re.i  1 1  /.at  i  on  ol  tin  opt  i  mum  i  treivi  i  t  host  i ,  del «  rm  i  res  w  hi  t  Ik  i 
lilt  receiver  "looks  adaplivt  Realization  I  has  a;  adaplivt  It  atari  in  that  component 
information  is  updated.  Or  tin  othei  hard  Realizations  III  and  IV  have  a  sepaialt  clunrtl 
lot  each  posstblt  component  ■■  nl  the  It  amine  n|  whli  h  component  is  hi  mg  sent  is  not  an 
obvious  I  eat  u r t  . 

A  problt  m  it.  rect  iv  t  t  dt  sim  that  lias  t  nit  ret  d  when  dealing  with  time  uni  t  rtaihty 
and  noiipt  riodti  compom  nts  is  tin  problem  o]  r  ct  ivt  r  complexity  or  mt  morv  Smct  it  is 
uni  t  r t;i in  whet  her  a  c onipot iei d  will  sic  1 1  or  not  the  net  i  v  t  i  des ign t  r  is  prest  nl ed  with  an 
exponentiallv  cn  wine  numbt  t  o|  tinii  patti  ms  ol  'unals.  In  tin  Sviuhronous  Poisson  1'inn 
St  i  uctui  a  .  let  i  i  st  mbit  .1  p.  is  s  i  lib  sin  a  I  s  prows  list  b  2  vv  hi  i  <  k  i  s  t  lit  i  di  \  oi  1 1  mi  and 

b  is  the  1 1 u m lx  r  ■  t  t  amp  t  nts  ,n  'In  comport  r.t  t  -o  mbit  .  P hi  imph  no  ,  tatioii  oi  simulation 

ol  such  a  n  i  i  ivt  i  dt  signed  d  tin  basis  •!  tins  pi  >w  n  g  t  :.st  mbit  can  i  aputlv  lit  tint  impiac- 

t  IC.i  i.  Oi.  t  In  o'  lit  I  hand,  tin  adapt  i  v  t  i  ->t  t|ut  :  t  la  I  r<  al  i/a  t  ions  pn  si  ■  ,  <  d  ha  v  a  In  t  dt  s  ip,  ed 

by  dt  st  ibing  ust  tul  signal  test  mbit  s  i  dii  t  t  tlx  ii,  1 1  i  ms  .|  <  a  m  |  om  nts  I  In  it  suit  is  a 
receiver  design  wliu  h  utilizes  a  fixed  si/t  nn  mot  v  I  in  important  reason  I  or  w  a  nl  i  up 
sequential  oi  adaptiva  n  ali/atmes  is  not  then  adaptive-looking  nature,  but  the  tact  that  this 
is  a  way  ol  n  alizing  the  optimum  receivt  r  with  a  lived  si/e  memory. 

5  3  Optimum  Adaplivt  Rteeiv«r  i)t  sipi  ,  Pi  i  mdo  Time  Strut  tun  Pnknowi  Hope!  it  um 
Freijui'no . 

In  this  section  a  idaptivt  reali/atioi  ol  the  optimum  receiver  is  presented  I  ir 
detecting  signals  with  a  Pt  nodic  Time  Structun  .  Tins  is  the  most  certai'  of  tin  thret  tinu 
structures  considered  ai  d  it  differs  from  the  sporadic  and  synchronous  cases  m  that  it  is 
It  amiable  Out  of  b  comp  in  nts  is  selected  for  tr.ii.snus  >n  md  Im  s.iiih  comport  t  n  <  urs 
periodically  thr  ughout  a  total  observation.  X  I  hi  repetition  Irequency  and  start  of  the 
period  are  initially  unknown  but  fixed  throughout  a  transmission. 


I  J 


The-  developin'  ->t  of  the  rci'i'iviT  i,  this  j-‘cti(ni  is  similar  In  the  development  of 
the  receive!  disip  led  (nr  the  Sporadic  -  I’m ssnii  lime  Structure  (set  Section  5.  1  The 
,'ll's!  three  steps  are  piven  nil  pupe  .15  1  this  section  tile  properties  uf  tilt  signal  for  the 

Pen  oil  u  lime  Structure  an  r  mnl'i  i.eil  with  I-  qs  3  H,  3.22,  and  3  23  to  obta  1 1  the  adapt  i  ve 

i  eceiv  ei 

5  3.  1  Periodic  Time  Structure,  l"i  know  :  Reju-titioi  f- requi  a  y,  Hea It /at i nn  I  This 
reali/attoi  follows  the  development  nl  the  receiver  lor  tin  Sporadic  -  Poisson  Time  Structure 
pm  '  in  Section  5  1  1  up  to  la)  5  12  I  hut  equation  for  the  sequential  tverupe  likelihood 

rat  m  was 


i .  n 


t .  n 


%  \-l 


\  ‘  l.  0 


V 


•k  Vi  "k-i'Vi  SNI 


(5  ! 2 1 


k  - 1  i.O 


(null  th..t  the  sipnul  properties  are  defined  m  terms  <>l  tin  penerutor  process,  pts^  «k  j 


SN). 


hy  hqs.  4.9,  -1.  10,  a  ,u  S.  11.  I  he  possible  st.tt  s  of  a  sipiml  sample,  s  are  the  possible 

K 

component  samples,  c^  for  i  1,2,  .band  ]  1,2,  ,  ie  The  number  of  samples,  n., 

of  a  component  can  tn  penerui  bi  variable  so  that  b  possible  components  can  Ire  defined  to 

repo  seat  b  possible  repetitnu  f re()uencies  c  ()  is  not  an  allowed  state  in  the  periodic  case 

sou  e  some  portion  ot  a  component  is  uluavs  present  11  die  development  tit  Section  5  1  1 

up  throuph  1  ()  5  12  is  modified  for  the  periodic  case  by  summmp  over  the  allowed  states. 

c  ,  c  .  c  .  an  analapous  equation  becomes 

t.l  i  2  i,n 

t 


.  i,  ii 
b  i 


I .  n 


t 


,,xkXk-i  ,  '  \  V  ^Sk  sk-rSN),,k-i,sk-i  SN)  '5'651 

1  1  sk  l\.l  Vl  ‘  l.l 


The  properties  of  the  penerator  process  for  the  Periodic  Time  Structure  are. 


P.sk  sk_,  SN,  1  for  skcs  j 


pis,  s,  ,  ,  SN)  1  for  s,  c 
h  k  k  -  1  k  t ,  1 


Vi  Ct,j-1  for  J  2'3' 


s.  1  r 
k- 1  i,  n. 


'4.  9) 
(4  10'. 


^kViSN)  ° 


otherwise 


(4  11) 
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Usrip  these  properties  and  the  notation  of  hq.  5.  16, 
hq.  565  as 


t.  (k) 
t.  J 


i),  Is,  c  SN),  out  can  wi  1 1 « 
k  K  i,  j 


fix, 


k- 1 


ti 

t  1 


l>  ik-1 
i .  ii 


f  x,  s  e 
k  k  t,  1 


J 


') 


I)  ,  k-  1  f 
i.  J-  1 


i.  J  I 
J 
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This  is  tin  equattoi  for  tin  sequential  average  iikehlioiai  ratio 

The  equations  that  update  component  identification  and  positional  inforni.it  ion  an 

obtained  by  following  steps  similar  to  those  that  lead  to  taps.  5  32,  5.  33  and  5  33  for  t  hi 

Sporadic- Poisson  Time  Structure  In  the  pi  nodic  case  the  sums  are  only  mi  l'  the  states 

c  ,.c  ,i'  Thus  hq.  5  28  becomes 

i.  1  i,  2  i,  n 

i 


,,Xk  Sk 


'V\  SN) 


V 1  l'l.  1 


Pk-1  Sk-I  svp  -’k  sk- r  SN 
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f'x,  X,  ,) 

k  k- 1 


Substituting  the  properties  oi 
a  lid  us  i  up  the  not.it  i  on  I)  ^  k 
equations  as 


thi  pent  rator  process  l.qs  3  b.  3  10.  and  3  111  into  hq 

p,  s  c  SN: .  ini  cat  write  the  component  updating 
1  k  k  i.  j 
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ii  iki 
l,  1 


b 

l ,  t 


k  - 1  f 1  x 

k 


f\ 

K 


X 


k-  1 


I 


f)  6 HI 


b  ki 
h  J 


ti  (  k  - 1 )  1 1  x.  s 
I ,  j  -  1  k  k 


ftx 


k 


X 


k-  1 


) 


i  l 

>iJ 


where  component  ident i ( k  at i on  information  is  obtained  by  forming 


6  G'b 

tort  2.3,  ,n 

i 


pk  (  ’  SN, 


n 

i 


j  i 


b  ki 

I. ) 
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The  desipn  equations  for  this  realization  are  summarized  m  Table  5.6. 
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TAB!  h  5.  6 

BASK  HI.C  HUH  DKSidN  Kgi  ATIONS.  PKJMODIC  TIM  1  STIUCTUHP 
UNKNOWN  KKPKTITION  Hi KQl  KN(  V 
KPAt  P/ATION  I 


Opliiiuim  Detect  i«  in  Output 


f,X,'  f  Xk-.)f,Xk  Xk-.> 


i  3  8) 


Sequential  Average  Likelihood  Hatio 


b 


i 


i.\.  X,  ,)  I)  lk-l)flx.  s.  c  .)  •  I).  ,(k-m(x,  s  c  )  (5  06 ) 

k  k- 1  ,  i,  n  k  k  i,  1  _  i.j-l  k  k  i,  j 

ill  ]  2  ‘ 


Classification  -  Cimiponent  Identification  and  Position 


b  !  k) 

i .  1 


b  ( k - 1 )  B x,  s.  c  . 
i.  a.  k  k  i,l 

i 


fUk  Xk-1! 


(5  68) 


b  ,'k-PCx,  s,  c  ) 

b  (kl  _JjJ.ll - Jl.Jl_JjJ 


1.  J 


Classification  -  Component  Identification 


"Xk  \- 


(5.  6b) 


for  j  2, 3, .... n. 


p.fC  SN)  b  (k) 

k  j  1  1 '  J 


'5,  70) 


5.  3.2  Operation  of  the  Adaptive  Deceiver  In  idealization  I,  the  Periodic  Time 

Structure  the  optimum  receiver  stores  information  obtained  from  the  past  observations,  ^ 

and  initial  knowledge  of  the  situation,  in  the  form  of  probabilities,  b.  k - 1 )  (see  Table  5  C). 

Sine  (  tin  interpretation  of  the  terms  b.  (k-1)  and  f(x,  s,  c,  .)  is  similar  to  that  eiven  for 

i ,  j  k  k  i,  j  * 

tlu  Sporadic  Poisson  Time  Structure  in  Section  5.  1.  2  it  will  not  be  repeated  Note  that  in  the 
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periodic  receiver  t hi  re  is  no  stale,  c 

i,0 

and  i  ^  terms  in  tin  receiver  operations 


This  is  reflected  in  tin  absenct  of  1)  ,.(k  1).  1- 

1.0  i 


5.3.3  Other  Heio  i\ er  Realizations  and  the  I  se  of  Memory  In 
ponent  identification  and  positional  information  are  stored  in  a  temporarv 
probabilities  b  (k-1  These  probabilities  are  updated  .liter  each  unit 


I.  J-l 

words  of  memory  are  needed  to  store  these1  probabilities 


i  1 


Realization  I  coni- 

memors  as  the 
i  liise  r  \  at  i  on  x 

k 


In  Appendix  C,  three  other  realizations  ol  the  optimum  recener  are  pres<‘nted  In 

Realization  II  I  Appendix  C  1  component  identification  and  positional  information  are 
1) 

updated  separately.  n  mints  an  required  m  a  temporary  memory  to  store  component 

i  1  ' 


positional  information  and  1)  words  to  store  component  identification  information 

In  Realization  HI.  there  is  a  channel  for  rail-,  of  the  b  possible  components  Kach 

channel  computes  the  likelihood  ratio  conditional  to  presence  of  the  ith  component  and  the 

channel  outputs  are  then  weighted  l>\  the  a  priori  probabilities  of  each  of  the  possibb 

h 

components  that  n  uld  occur.  words  ar«  needed  to  store  compoi  ent  uientificatioi  and 

pi  is  it  toiia  1  informal  ion  and  b  words  to  st  or  <  t  lie  (  i  (  1  terms. 

Realization  IV  (Appendix  ('.  3  i.-,  the  simplest  ol  the  four  realizations.  These  receiver 
design  equations  are  summarized  in  Table  5  7  and  a  block  diagram  is  shown  in  Fig.  5  12, 


TABU-  5  7 

BASIC  RhCKIVFR  DhSICiN  KQl’AT 'IONS,  RKRIODIC  TIMI-  SHUT  ITKK 
I’NKNOWN  RKIUTITION  f  Rl-giTAC'i 
RI-  AI  J  ZA  I  ION  IV 


Op  1 1  muni  I  Jet  ec  Mo:  i  Oi  j  tp  u  t 


MV 


t) 


I  1 


n 


I 


1  1 


Q  (k 

i.  J 


(C  13) 


Information  Updatuip 


g.  ,!k)  Qj  nfk-i)ffxk  sk  c  ) 

l 


( C  11) 


(  1 2 
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Q  k  Q  ,  i  k  - 1  f '  v  .1,  c 
i,  j  i.  j-  1  k  k  i  ] 


Ini)  2.3 


Classification  -  Component  Idee’  ticalion  and  Position 


t)  ik 
i.  J 


Classification  -  Component  Identification 


\  44 


'V(  l  SN 


1 1 

I 

Q  k 
i  «•  J 


fiX 


k 


t 


A  451 


Here  the  receniT  updates  the  quantities  Q  1  k!  f  X.  U)  ( k )  directly  .’snip  laps  C  11  and 

i ,  j  k  i ,  j 

C.  12.  from  the  Q  I  ki  tt  rms  the  likelihood  ratio  can  be  calculate  1  by  simple  add  it  ton 
b  '•  1 


t  1 


n  words  are  required  to  store  tin  O  (k  terms  just  as  in  Realization  I  llimcvr,  b\ 
i  1  t.  J 


comparing  I  allies  5.  (3  and  5.7,  it  can  be  seen  that  the  operations  performed  by  Realization  !V 
a  re  mur  h  si  mpli  r 

In  all  four  receive!  realizations  lor  the  Periodic  !  line  Structure,  the  receiver 
memory  is  finite.  I  fits  result  is  not  surprising  here  since  this  signal  ensembh  does  not 
(troii  w  ith  time 


5.4  Optimum  Adaptive  Receiver  Design,  Periodic  lime  Structure.  Know  r  Repetition  h  requeues 
In  this  section  an  adaptive  reuli/.ition  of  the  optimum  receiver  is  presented  lor 
del  ect  in  i;  signals  with  a  Pi  r  iodic  lime  St  ructure  in  which  the  repetition  I  requency  and  tin  start 
ol  tin  period  art  known.  This  is  the  usual  classical  periodic  case.  One  of  b  components  is 
selected  lor  transmission  and  tin  same  compom  nt  recurs  periodically  throughout  a  total 
observation,  X^.  In  this  case  the  observations  can  be  processed  ill  blocks  of  time  equal  to 
a  i  miponent  duration.  The  notation  used  Is  the  same  as  that  used  in  the  Synchronous - 
Poisson  Time  Structure.  In  other  words,  x  is  an  n  -dimensional  observation  having  t hi 

K  I 
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durat inn  n!  a  c  ompoi  cut  and  5,  is  an  n  -dimension.! I  segment  m  t tie  signal.  The  opt t mum 

K  l 

i  i  c  (  i  \  it  is  t  lie  same  as  t  hat  which  would  result  1 f  i  wire  set  equa  I  to  one  in  hq.  1 1  17, 
Iabli  5  5.  I  In  equations  lor  tilt  rec  eiver  design  are  presented  in  Table  5  8. 


I  AIII.K  5  H 

BASIC  HHTIVHI  BI-SKA  I  gi'A TIO\S.  PKRIODIC  TIM  I-  STFH'CTl'iU- 
KMM\  KH’KTIIION  HIKQI  KNC’i  KNOW,  N  START  OF  PKKIOI) 

Rf-AI.IZA  HON  IV 


Opt  i  mu m  Detec  1 1  oi  Output 


b 

f(X  )  Qtk) 

K  .  1 


(B  14) 


I  ifcirmution  I  pdatin^ 


g  k  gik-liMx.  S,  ( 

t  i  k  k 


(5.  7  1) 


Classification  -  Component  Went  i  Beat  imp 


g  (k) 

>’kic'‘  SN)  rT XT. 

k 


(B.  20) 


Let  us  consult  r  this  rei  eiver  in  more  detail  for  the  case  of  added  white  Gaussian 
noise.  In  that  c  ase,  for  the  noise  power,  N,  equal  to  one, 

c'cr 


sk c  1 


xk c 


(5.  72) 


and  so 


g  (k)  g  Ik  1)  e 
t  i 


Yf 


,i  c  •  c 


(5.  7  3) 


But  by  repeated  application  of  Kq.  5.73,  g.(k)  can  be  written  as 


6 


g  k i  g  iOi  * 

i  i 


5  7  4 


a  ucl 


l  X 


-k 


(.'  (  . 


i  0 


g  in 
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J  i 
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From  this  equation  one  can  sit  that  th(  obst  nations  iIii'iiim  lies  ran  lust  hi  added  m 
s  vnchrono-js  inti  rv.tl.s  and  this  sum  rut  r»  latrd  with  each  <>l  ‘.h<  possible  compm  enis 

When  tin  component  is  known  exactly.  a  monotom  tunitimi  nf  tin  likrl  iln  n  kI  ratin, 
whirh  is  also  nptimuin,  is  simplv 


M  X,  C1 
k 


5  7  ti 


In  this  rase,  the  observations  the msel\ rs  mav  l>r  simplv  accumulated  and  the  sum  cm  related 
with  tht  known  component,  C'1 


5.5  Comparison  of  Receivers  (or  Synchronous- Poissoi  ami  Periodic  Time  Structures 

It  is  i  ut  ‘fist  i  up  to  compare  the  optimum  rent  iters  tor  t  lit  Sy a  r  hro-.t  .us  -  Pmssi  i, 
and  Periotlic  Time  Structures  when  the  repetition  :  requei.cv  is  ki  own  I  list.  Consult  i  tin 
cast  of  component  known  exacllv  (  KI  u  atltleti  w  hi  1 1  (inussian  must  A  block  diaprun 
of  the  optimum  ret  eiver  for  the  Periotlic  l  ime  Stiucture.  obtain'd  by  setting  b  !  in  tin 
equations  of  Table  5  H,  is  shown  in  hip  5  13  a  A  realization  of  the  optimum  recniter  for 
the  Synchronous  Poisson  l  ime  Structure,  obtained  by  settmp  I)  1  in  fable  5  5.  is  show 
in  I-  ip.  5  13b 

In  tin  pt  notin'  cast  tin  adder  and  Tj  delay  recirculate  the  input  war  esh.ipes, 

x  . ,  x„ . x  Recall  ;  hat  in  t  his  periodic  cast  .  x  rep  rest  i  ts  an  input  obst  nation  of  2U  I  , 

12  k  i  1 

samples.  After  tin  observation  x,  ,  the  receivci  has  formed  x,*.\„>  ox,  and  this  averape 
'  k  12k 

waveshape  is  correlat eti  with  the  component 

The  optimum  receiver  (see  Fip.  5.  13  b  for  the  Synchronous  -  Poisson  Time  Structure 

does  not  simply  add  the  input  waveshape  in  synchronous  intervals.  Instead,  a  more  abstract 
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quantity.  .t  likt  1 1  hood  ratio,  is  recirculated.  The  observation,  x  is  first  correlated  with  the 
knowi  compo  *  f  waveshape,  a  bias  term  is  subtracted,  a. id  tilts  quantity  ts  then  fed  into  a 
non!  i  ne, i  r  1 1  \  .  which  is  a  function  of  the  duty  factor.  The  sync  hi  onous  sum  of  such  non  - 
1  near  functions  of  tin  input  signal  and  noise  waveshapes  are  stored 

\i\t,  let  us  compart  t  lit  optimum  i  i  reivers  for  tin  Sy  c  hr  onous- Pmssoa  a  id  PeruKlu 
I  lint  Struct  ui  es  w  hi  t,  t  fie  compoi.e  .1  is  known  st.it  ist  ically  '  CKS  .  A  block  diagram  of  t  he 
ret  cm  r  lor  tin  lb  nodic  Time  Structure  was  shown  in  Fip  5  12  and  the  receiver  for  the 
Synchronous  -  I’oiss  lime  Structure  was  shown  t..  lip  5  11  Tin  receiver  (or  the  periodically 
recurrent  rompnt  ent  is  simpler  u  two  respects,  the  number  of  recirculating  delays  and  the 
nonlineanties.  I  tht  periodic  case,  the  observations  are  recirculated  by  means  of  a 
smple  adder  anti  a  T.  delay.  fhese  outputs  art  fed  into  b  parallel  ch.mmds  where  they 
art  correlated  with  each  of  the  possible  components  that  could  occur  exponentiated,  and 
summed  in  a  final  summer  I  (fit  receiver  lor  the  synchronous  case,  however,  a  likelihood 
rap.t  rather  than  an  input  signal  plus  noise  waveshape  is  circulated  1  h<  input  obs<  rvation 
i.i  correlated  wit'  each  of  tlie  possible  eumpont  its.  fed  into  a  nonlinearity  which  depends  mi 
t  fie  duty  factor.  and  then  stored  and  recirculated  Ih  si  outputs  are  th.en  summed  ! 
torm  tin  detection  output  Thus  the  refiner  lor  the  periodu  i  asi  is  much  simpler  since 
the  input  wavesh.ipt  cat  be  recirculated  with  a  single  adder  and  tli  lay 


h 

Delay 

_ k _ 

1 ' 

i 

k 

...J 

(Input)-  (’ 

Detection 

i  j 

V - w 

Output 

ftp  5.  13  a  Optimum  receiver,  (.  Kh  .  Periodic  Time  Structure 
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5.6  Summaiy  <>l  Chapter  V 

In  this  e  lupt  e  r  optimum  r<  .'cm  r  5.  sips  ha  v  e  lire;  dec  elo|  ed  t  ■ '  del  ret  a  rec  urt  <  c  t 
phenomenon  m  noi.se.  The  receives  .<ie  time  varyinp  m  the  sens'  ll.it  they  are  capable  ol 
proiessinp  an  increasmplv  lonpei  tbscrvalion  and  an  capable  ol  makinp  a  correspondinp 
optimum  decision  .is  to  pres* no  or  absence  ol  t  hi  n  i  urrence  phenomenon  i  that  observ  ation 
There  is  uncertaintv  in  wine'  component,  out  o|  a  finite  class  ol  component  ..  will  lie  selected 

and  theie  is  unci  rtaintv  in  the  recunence  times  ol  a  . .  .1  Threi  basic  Ispes  of 

recur  relic  e  - 1 1  me  uneertaint  \  are  eonsuleied.  Sporadic  -  Poiss  m.  S\  nchronous  -  Poisson  and 
Pt  ne  hc 


Th«  approach  used  in  ties  i  pi  a  up  tin-  i  eceiv  <  r  has  bet  n  to  solve  an  ov  er  -  a  1 1  opt  i  m  i/at  toi 
problem  and  then  to  realize  this  optimum  receiver  in  a  sequential  manner  that  works  on  a 
component  basis  In  otlu  r  words,  suit  e  tin  pnmarv  poal  is  detectinp  tile  recui  rence 
phenomenon  duriup  the  observation  X  tin  likelihood  rati"  ol  the  observation.  X  ,  is  formed 
and  put  into  an  equivalent  foi  m  in  which  component  information  is  updated  Since  the 
i  ecei  v  er  dev  t  1  opment  starts  with  the  likel  i  hot  k!  rat  i  o  ol  the  obser  v  at  i  on  X  it  is  opt  i  mum 
VVt  art  assured  that  tin  opt  ration  of  the  receivt  r  o  a  local  coinpoi  cut  basis  is  correct  since 
t  lit  1 1  we  i  v  ei  tlesipn  is  a  result  of  1 1  a :  si  or  m  i  np  this  b  kel  i  hootl  ratio  into  an  equi  v  a  lent  f  u  m 
A  coat  rast  i  np  method  of  attack  would  be  to  formulate  the  detection  problem  on  the  basis  of 
detectinp  a  sinplt  component  and  to  tlvn  combine  thesi  tesults  in  a  manner  that  would  result 
in  an  optimum  decision  over  the  entire  observation 


Provulinp  the  required  amount  ol  receiver  memorv  is  a  basic  difficulty  which  emerpes 


in  the  tlesii'.n  of  the  optimum  receiver  for  nonperiodic  components  There  art  as  m;i  ly  signals 
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tn  tilt  signal  east  mlilc  as  t lit- r t  a  n  components  in  tilt-  component  ensemble  multiplied  by  tilt 
it u n i i it  i  (  |>  issiblt  t  um |)t H 1 1 ■  nt  1 1  nit  patterns  This  is  a  fi\ed-si/e  ensemlile  (nr  all  time  for 
eninpn  tuts  rerurrmp  w  ilh  a  Periodic  lime  Structure  However,  for  I  he  Sporadic- Poisson 
and  Syiictinmnus  Poisson  lime  Structures.  the  signal  ensemble  prows  with  time  II  the 
nt  i  i  \  ers  .tie  ties  ipnetl  us  i  np  c  las  si  cal  t  er  m  1  nt  ib  ipy ,  they  become  ton  complex  To  obta  1 1 
ret  t  ivt-rs  with  a  iixed-size  memory  nr  receiver  structure,  tile  sipnal  ensemble  is  deScrii)t*d 
i  din  i  tlv  n  Inins  nt  components  and  t  i.e  time  structure  Other  time  structures  besides  the 
time  considered  t  mild  be  studied 

Vie  hale  set  n  how  tile  optimum  rect  iver  can  lie  put  into  different  forms  Different 
aspects  nt  tile  receiver  operations  are  explicitly  displayed  by  t iie  particular  realization 
i  hosen.  It  is  an  i nt  i  rest  i up  side  llplit  that  sequential  realizations,  such  as  Realizations  ! 

.old  II  often  appear  to  w  u  k  in  an  adaptive  manner  These  realizations  display  an  explicit 
updatmp  oi  component  information,  pivinp  them  .»  "learning"  feature.  On  the  other  hand,  in 
Realizations  l!I  and  l\  it  is  not  so  obvious  that  the  receiver  is  learninp  the  componei.t 
st  lei  ted  since  the  receiver  does  not  explicitly  work  with  component  quantities.  In  any  of 
tin  realizations,  classification  information  can  be  obtained  tepardless  of  whet  tier  the  receiver 
appears  to  use  it  ot  not 

I  he  quantities  stored  in  the  receiver  memory  depend  on  the  time  structure  of  the 
sipnai  and  tile  particular  realization  chosen.  For  the  Sporadic  -  Poisson  Time  Structure, 


component  identiliration  and  local  component  positional  information  are  stored  and  updated. 

I) 

In  Realization  1  this  information  is  combined  in  the  b  (k  matrix  n.  words  are 

t.J  n  1 

required  m  a  temporary  memory  to  store  this  information  In  Realization  II.  component 

identification,  p,  fC'1  SNi  and  local  component  positional  information.  IF  Ik),  are  stored 
k  b  ,lJ 

in  separate  ti  nuior.iry  memories.  n  words  of  memory  are  needed  for  IF  (k)  and  b 

;  ,  i  1  b  !'J 

words  lor  p  iC‘  SNl  terms.  In  Realization  111,  n  words  of  temporary  memory  are  needed 

k  111  i 

to  store  component  identification  and  positional  information  and  I;  words  to  store  ffX.IC  ) 

b  R 

ti  rms  In  Realization  IV,  words  of  memory  are  needed  to  store  Q.  (k)  terms 


Foi  the  Synchronous  -  Poisson  Time  Structure,  only  component  identification  information 


must  tie  stored  since  tnere  is  no  uncertainty  about  component  position,  ’n  Realization  f  this 


HO 


informal  mi  is  stored  as  p  (C1  SN)  and  h  words  of  temporary  memory  arc  required  1 

Realizations  Hi  and  IV,  b  branches  are  needed  lor  each  of  the  possible  c. impel. e  it*-. 

for  the  Periodic  Time  Structure,  unknown  repetition  frequency  component 

identification  and  local  positional  information  are  stored  in  a  ttmporars  memory  In 

b 

Realization  I  this  information  is  combined  in  the  b  k )  matnx  and  n  words  an  ceded  I 

t.J  ,  ,  ' 

stort  this  information.  In  Realization  II  t  etitpoi  ent  ulentific.itn  n  .ind  positional  information 

b 

have  been  separated  so  th.it  n  w  ords  an  iceded  to  store  positional  ml:  ir  mat  ion  and  b 

i  1  1  b 

words  for  identification  information  In  Realization  III,  words  am  used  t  store 


i  1 


i 


,  ,i , 


component  identific  ation  and  positional  information  and  b  words  to  store  (  X  (  Met  ms 
b  k 

Ii  Realisation  l\.  words  an  used  to  store  the  (.,)  k;  terms  vVhei  tin  repetition 

i  1  ' 

freciuencv  is  know  as  well  .is  the  start  of  the  period,  only  I)  word  •>  of  compo  ent  idt  nt  1 1  ic.i  t  ton 
information  must  be  stored 

The  fixed-size  memory  or  receiver  structure  of  the  adap'ivc  realizations  presented 
ii  this  chapter  is  importai  t  foi  two  reasons  first,  it  is  a  nrcessan  realization  in  terms 
of  providing  a  practical  receiver  implementation  The  second  interest  is  in  repaid  to  optimum 
receivt  i  performanci  In  ord<  r  to  exannm  the  ellt  cts  of  time  uncertainty  on  detei  tabilits 
for  the  optimum  receiver  it  is  first  nrio  ssarv  todesipn  this  receiver  I  lie  adaptive 
reali/atioi  provides  a  reccuei  that  is  n  <t  e  maiiupeabb  ,  m  many  cases  and  eai  then  foil 
be  evaluated  analvtieallv  or  tiy  simulation  techniques  with  a  dipital  compute!  Ihe  much 
simple  i  adaptivi  realizations  enatib  us  i  stuck  how  turn  incert.iinfv  affec'ts  die  pc.  lot  inuiun 


of  the  optimum  receiver.  Nils  os  ai.  area  ol  stuck  that  lie-ins  n  Chapter  VII 


(  MAPI f  H  V  I 


OI'IIMIM  UK  HUH  1)1  SKA  SPKIAi  (ASKS 

1 1  (  li.i | > 1 1  r  \  tin  i It  s u' 1  )|  -  >pt  i ii ui in  1 1  <  ci  v  i  i  s  ius  i  .i r nt'ii  through  in  i  a t  lit  r 
i4 1  •  i ,  i  r I  1 1  i  ii  i  -i  I  thin  c  I  ui  jit  i  i  st  i  i  a  I  hum  t  llanei  ms  <  ast  s  n|  rrn  iui  design  will  lit 
c i ms ul v r  is!  I  in  m -  a tit  i  w  lit i  is  t  i  t r  n  st t  <l  r« ct  i \  i  r  pe rl 1 1 1  m a  t  e  and  t  lit  t- 1 f ft* t  ol  1 1 nit 
uin  i  1 1  .i  1 1  .t i  an  ui  i  t  c  i  (  ha  pit  r  VII  a  1 1  in  j  u  i  1 1  iss  nt  <  1 1 1  it  mu  it  v 

ti.  1  I'niiti  Class  ul  Pi  i  1 1  k  1  i  t  I  <ju,il  Amjilituili  Pulses.  Known  hxactly  hxccjit  for  Hejietition 
1- 1  i-tjui  i  u  s . 

Consult  i  tin  problem  til  optimum  tli  1 1 1 1 > » n  of  a  periodic  pulse  sequence  when  tin- 

pulsi  vta.t  shapi  is  ki  uv.ii  exactly  hut  tin  repetition  frequency  can  he  one  of  a  (mite  number 

■  !  values  I  ins  i  lass  u|  signals  can  In-  thought  "f  as  a  liniti  class  o|  periodically  recurrent 

<  "inpoia  .its  '.tin  it  each  ci >m pi 1 1 ii •  n t  has  n  sample  values.  Kacli  component  is  then  ol  the 

i 

I  or  in  (  i  j .  0 .  0 .  0 .  .  b  ii  which  the  i  uiiiln- r  of  component  samples  is  equal  I  o  n  . 

I  In  various  possibli  repetitim  liequeiicies  art  specified  bv  stating  tht  class  of  n  values. 

Anv  ol  tin  basic  loui  reali/ations  coultl  of  course  be  considered,  but  Realization  IV 
is  tin  simplest  ami  wt  will  consult!  it  from  I  able  5.7  the  lalnrmatioii  updating  equations 

•  III  CIVIC  b\ 


g  ki  g  six,  s,  t-  c.  id 

I  ,  J  I  .  I  i  k  k  1  1 


g  tk)  g  ,  (k-l)f(v  s,  c  i 

i  )  i ,  j  - 1  k  k  i 


lor  j 


2.3.  ...  n 

i 


(C.  121 
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Hut  li>i  signals  m  added  whiti  Gaussian  imi.si 


U  y  s  <•  1  tor  i  2.3, 

k  k  ..  j 


sci  i.(|.  C  12  becomes 


J  (k)  Q  ( k  1)  lor  i 
i.  J  i.  J-  1 


The  detection  output  (lit  likelihood  ratio  of  th<  obst  rvatioi  X  is  pu  i  lis 

K 


b 


(X  i  y  ( k  i 

k  .  1  fl  KJ 


If  13) 


which  can  be  written  usinp  hq.  f.  11  and  G.  2  as 


“V 


i  1 


f(\,  s,  (  ,i  y  k  1  •  <)  .  i  k  - 1 

k  k  i.l  i .  n  ..  i .  j  -  1 

i  J  2 


J 
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II  all  pulses  are  of  equal  amplitude  a"  then  e  ^  a  lor  all  i  anti  lap  G.  3  can  In  written  as 


b  b  "i 

GX,  Gy  s,  a)  y  i  k-  1)  •  ,lk-  1 ) 

k  k  k  ,i,i;  ,  ..  i.  i  -  1 

i  1  i  i  I  j  2 


(G  -I I 


Hut 


J  3 


y  ik- i  i  -  y  ik- 

,  i.j-i  l.n, 


id  hi 


Si  i  r.q  G  .  4  c.i  n  l>i  W  l  1 1 1  ei , 


(  X,  b 
k 


n 

y  Ik 

i  1  i 


G  G  i 


From  l-t|  G.  G  him  can  see  that  tin  optimum  reci  ivi  r  forms  the  like  1 1 hood  ratio  of  the  uml 

observation.  \  ,  piven  a  pulse  is  present  and  subtracts  from  this  the  value  one.  I  his  is 

k  b  b  b 

multiplied  b\  tin  sum  Q  ( k  -  1 )  which  is  MX.  p  ,ts,  ,  c  I.  So  y 

,  i.n  k-  1  '  k- 1  k  -  1  i .  n  .  i  n 

ill  i  1  i  i  1  i 

has  t>ie  inti  rpn  tatiou  of  bemp  tin  likelihood  ratio  •(  t  fit  observation  X  j  times  tin  probability 


alter  takinp  th  Ik  list  observation  that  thefk-llst  observation  is  the  last  sample  valui  just 

I, 


piim  to  a  pulse  incurrence,  i.veh  though  (  X 


y  i  k  1 1 . 


,  l.  n 
l  1  l 


requi  res  >lll\  t he  sum . 
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both  i  ‘imp  '  t  nit  I  Mi. tti"i  .mil  po.i  t'.on.il  i nlormat i on  must  Ik  updated  to  keep  the  sum 

U|  t  lull 

G  2  1  k  ‘Uni  Jut  \  1  act  i 

'I  hi  piissitiihts  i|  .i  i  > 1 1 ipmieiit  rerurnnp  with  a  duty  (actor  which  is  one  of  h 
posMblt  dul\  tact  as  has  .tin  a  i\  been  incorporated  into  the  receiver  design  equations  .once 
i  i  an  have  a  dilli  it  ni  \alm  !  i  each  possible  component.  For  example,  il  the  component  is 
known  i\.utl\  t(  K1  a  id  tin  tin  e  structure  is  Synchronous  -  Poisson,  Idealization  IV  becomes 
a  smelt  iiosst  i  relat  i  ihai  if  relates  the  unit  obst  rvation.  \  with  the  component  C  and 
subtracts  the  bias  term  (  (  This  is  then  fed  into  l>  parallel  t  nonlinearities  and  these 
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The  stall  diagram  for  two  nonovi  rlapptnp  components  is  shown  m  Fu.  6.  3.  Now,  the 
upd.it urn  equations  I  r  Realization  IV  become 
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Vie  an  in ti  rested  in  tile  lollewillp  Items 

1  Idle  opera), on  of  a.  adaptive  receiver  realization 

?.  detection  performance  of  the  optimum  adaptive  receiver  for  some 


spt  eia  I  i  a  si  s. 

3.  Flint  ot  component  uncertainty  on  detectability. 

•1.  F  ffect  of  componei  t  i  ecurrenci  time  uncertainty  on  detect  oility. 

5.  <  Miipansoii  between  the  optimum  adaptive  receiver  and  the  simple 

i  i  rpv  di  t  ecti  i 

ti.  (jiinpai  ismi  of  the  perfoi  mance  *>(  other  suboptimum  receivers 
with  t  tu  i(it  i  mu  in  reo  iver 

Meli  it  i  onsidcrinu  these  items,  let  us  briefly  review  the  basic  tec  Uniques  of  receiver 
i  v  a  I ua 1 1 on. 
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Digital  computer  simulation  of  adaptive  receiver  one  of  eight 
orthogonal  components.  Synchronous- Poisson  Time  Structure 
signal  and  noise,  runs  9-17. 
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Digital  computer  simulation  of  adaptive  receiver,  one  ol  eight 
orthogonal  components.  Synchronous  -  Poisson  Time  Structure 
signal  and  noise,  runs  27  -  35 
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Fig.  7.  8  Digita.  computer  simulation  of  adaptive  receiver,  one  of  eight 
orthogonal  c  >mponents  Synchronous  -  Poisson  Time  Structurt. 
signal  and  noise,  runs  45  -  53. 
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orthogonal  components,  Synchronous-Poisson  Time  Structure, 
signal  and  noise,  runs  81  -  89. 
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Digital  computer  simulation  of  adaptive  receiver,  one  of  eight 
orthogonal  components.  Synchronous- Poisson  Time  Structure, 
signal  and  noise,  runs  90  -  99. 
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The  final  column,  labeled  MAX  P(C'ISN).  is  a  function  constructed  from  the 

i 

classification  outputs.  It  is  obtained  by  picking  ihe  largest  of  the  eight  classification 
outputs  at  each  instant  in  time.  The  scaling  goes  irom  zero  to  one.  The  second  column, 
labeled  Log  f(n(t)),  is  the  sequential  detection  output  when  noise  alone  is  present  to  the 
receiver  input.  (The  initial  negative  pulse  in  each  of  the  traces  of  detection  and  classification 
outputs  should  be  ignored. ) 

In  runs  0  through  99,  component  C*  was  the  actual  component  transmitted  and  it 
was  recurrent  in  all  of  the  runs.  A  wide  variety  of  detection  and  classification  responses 
result.  The  reader  can  obtain  an  idea  of  the  number  of  component  arrivals  by  looking  at  the 
signal  energy  plotted  as  a  function  of  tone  in  the  first  column. 

Since  each  of  the  eight  components  was  assumed  equally  likely  at  the  start  of  a 
transmission,  the  probabilities,  P(C11SN),  were  each  initially  set  at  1/8.  In  a  majority 
of  runs,  the  classification  output,  P(C*!SN),  rises  abruptly  after  a  sufficient  number  of 
components  have  recurred.  Due  to  the  noise  and  the  fluctuations  in  total  signal  energy 
from  run  to  run,  the  time  of  rapid  build-up  of  P(C’iSN)  varies.  For  instance,  in  runs  0, 

3  and  71  the  abrupt  changes  occur  early  whereas  in  a  run  such  as  70  there  is  a  considerable 
delay  before  the  receiver  "learns”  which  component  is  being  transmitted.  On  the  other 
hand,  there  are  runs  where  no  abrupt  rise  in  the  classification  output,  P(cMsn),  occurs 
even  though  C*  is  being  transmitted.  Such  cases  are  shown  in  runs  20,  26,  35,  59,  68  and  74. 
There  are,  in  fact,  a  few  runs  in  which  the  receiver  has  "learned"  the  wrong  component. 

This  has  happened  in  runs  64  and  92. 

To  see  how  the  detection  and  classification  outputs  respond  to  noise  alone,  an 
additional  set  of  27  runs  were  made.  These  runs  are  shown  in  Figs.  7.  14  through  7.  16 
as  runs  100  through  126.  The  labeling  and  scaling  in  these  runs  is  the  same  as  in  the  first 
100  runs  except  an  additional  quantity,  labeled  "Selected  i",  is  plotted  in  the  last  column. 

This  is  a  plot  of  the  component  whose  probability,  PiC^ISN),  is  a  maximum  at  each  instant 
of  time.  The  scaling  on  the  "Selected  i"  column  is  quantized  in  unit  steps  from  zero  to  eight. 
In  the  noise  alone  runs  of  Figs.  7.  14  through  7.  16  the  detection  output,  in  general,  drifts 
downward.  In  general,  the  classification  outputs,  P(cMSN),  give  no  consistent  indication 
of  any  particular  component.  There  are  occasions,  such  as  runs  115  and  122,  where  the 
receiver  "learns  a  component  even  though  noise  alone  is  present.  The  fact  that  the 
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Fig.  7.  14  Digital  computer  simulation  of  adaptive  receiver,  one  of  eight 
orthogonal  components.  Synchronous-Poisson  Time  Structure, 
noise  alone,  runs  100  -  108. 
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orthogonal  components,  Synchronous-Foisson  Time  Structure, 
noise  alone,  runs  109  -  117. 
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Digital  computer  simulation  of  adaptive  receiver,  one  of  eight 
orthogonal  components.  Synchronous- Poisson  Time  Structure, 
noise  alone,  runs  118  -  126. 
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adaptive  realization  occasionally  indicates  the  wrong  component  is  of  couise  not  a  fault 
of  the  adaptive  realization  but  a  reflection  of  the  statistical  nature  of  the  noise  and  signal 
uncertainties. 

The  127  individual  runs  have  been  displayed  in  Figs.  7.  3  through  7.  16  in  order  to 
observe  how  an  optimum  receiver  which  has  been  realized  by  an  adaptive  realization  operates. 
Recall  that  an  important  motivation  for  the  development  of  an  optimum  adaptive  receiver  is 
the  complex  nature  of  the  nonsequential  realization  (see  Chapter  V).  In  the  problem  simulated 
here,  there  are  eight  possible  components  in  the  component  ensemble  and  2  possible  time 
patterns  of  component  occurrences.  In  terms  of  a  formal  nonsequential  receiver  realization, 
this  would  require  the  storage  of  a  priori  probabilities  for  8  •  210tJ°  thousand- dimensional 
signal  vectors  along  with  8  •  2^^  multipications  of  each  of  these  probabilities  by  the 
likelihood  ratio  conditional  to  each  of  the  time  patterns.  Such  a  receiver  realization  is  much 
too  complex  to  be  simulated  even  on  modern  digital  computers.  Such  a  realization  also 
appears  "nonadaptive.  "  On  the  other  hand,  by  going  to  the  adaptive  mode,  the  optimum 
receiver  has  been  simulated  by  storing  eight  probabilities,  P(C  ISN),  and  continuously 
updating  them  as  t he  observations  come  in.  Although  the  primary  reason  for  operating  the 
optimum  receiver  in  the  adaptive  mode  was  to  greatly  reduce  receiver  complexity,  the 
resultant  adaptive  realization  displays  "learning"  features  which  are  hidden  in  the  nonsequential 
mode  of  operation. 

Although  it  is  interesting  to  look  at  each  of  the  runs  of  the  adaptive  receiver,  the 
variety  of  receiver  outputs  is  too  great  to  tell  just  how  well  the  receiver  is  performing. 

In  order  to  evaluate  the  adaptive  receiver  properly  we  need  to  obtain  the  ROC  (receiver 
operating  characteristic).  This  can  be  done  by  properly  using  the  data  from  all  100  runs 
to  obtain  the  approximate  ROC  at  several  points.  From  these  ROC  s  we  can  obtain  a 
meaningful  estimate  of  the  way  the  detectability  builds  in  time.  This  will  be  deferred  to 
Section  7.3.2.  3. 

7 .  o  Receiver  Performance 

In  Section  7.  1  the  basic  problem  of  receiver  evaluation  in  terms  of  the  ROC  was 
reviewed.  In  Section  7.  2  individual  operating  runs  of  an  optimum  adaptive  receiver  are 
displayed.  The  ROC  for  a  number  of  cases  will  be  obtained  in  this  section. 


i  n  ^ 


It  is  necessary  to  determine  the  probability  density  function  of  the  likelihood  ratio 
or  a  monotone  function  of  it  under  both  hypotheses  in  order  to  obtain  the  ROC  for  the  optimum 
receiver.  Two  approaches  can  be  used  to  obtain  these  density  functions  -  an  analytical 
approach  and  an  experimental  approach.  While  the  analytical  approach  can  lead  to  "exact" 
answers,  considerable  difficulties  in  performing  the  necessary  integrations  frequently  result. 
The  experimental  approach  referred  to  is  a  Monte  Carlo  technique  using  the  digital  computer 
as  an  experimental  tool.  In  this  approach  it  is  necessary  to  represent  the  input  noise  and 
signal  plus  noise  density  function  by  a  discrete  set  of  probabilities.  It  is  also  necessary  to 
make  a  sufficient  number  of  runs  in  order  to  obtain  confidence  in  the  results.  The  total 
number  of  runs,  However,  is  limited  by  the  cost  of  computing  time. 

The  receiver  evaluation  is  separated  into  three  parts  according  to  the  time 
structure;  ti  e  Periodic,  Synchronous- Poisson,  and  Sporadic-Poisson  Time  Structures.  The 
simplest  time  structure  is  the  periodic  structure.  This  type  of  time  structure  is  characteristi 
of  many  active  detection  and  ranging  systems  working  in  a  stable  medium;  the  detection  of 
such  signals  has  been,  well  understood  for  a  number  of  years.  It  is  included  here  so 
comparisons  can  be  readily  made.  The  next  order  of  complexity  in  time  structure  is  the 
Synchronous-Poisson  Time  Structure.  It  is  like  the  periodic  case  in  that  if  a  component 
occurs,  it  starts  only  at  synchronous  times.  That  is,  it  starts  only  at  integral  multiples  of 
a  component  duration.  If  it  were  always  triggered  a  periodic  signal  would  be  generated. 
However,  it  is  only  triggered  sonic  small  percentage  of  the  time.  The  third  order  of  time 
structure  complexity  is  the  Sporadic-Poisson  Time  Structure.  In  this  time  structure  a 
component  can  start  at  times  other  than  multiples  of  a  component  duration. 

The  component  uncertainty  is  represented  by  a  component  ensemble  consisting  of 

equal  energy  orthogonal  components.  There  are  M  components  of  common  duration  Tj  The 

M 

minimum  bandwidth  must  be  — -  so  tlial  2WT^  is  at  least  M. 

In  this  chapter  a  number  of  experimental  ROC's  have  been  obtained  for  the 
Synchronous-Poisson  Time  Structure.  These  will  be  compared  with  the  known  performance 
for  the  Periodic  Time  Structure.  Since  uncertainty  increases  in  going  from  the  Periodic  to 
the  Synchronous-Poisson  to  the  Sporadic-Poisson  Time  Structure,  and  since  performance 
necessarily  drops  as  uncertainty  increases,  the  results  of  the  Synchronous-Poisson  case 
can  be  used  as  an  uppi  r  bound  on  the  detection  performance  for  the  Sporadic-Poisson  case. 
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vVl  are  especially  interested  in  cast  .->  where  the  duty  factor  is  low  and  the  input  signai-to-noise 
ratio  is  sufficiently  small  so  that  a  receiver  could  not  make  a  good  decision  on  the  basis 
of  a  single  component  occurrence. 

In  the  classical  theoiy  ,  the  SKE  (signal  known  exactly)  is  an  important  reference 
case.  For  this  case  there  is  no  uncertainty  regarding  the  signal.  In  the  recurrent  component 
problems  we  will  use  the  CKE  (component  known  exactly)  for  various  time  structures  as  a 
basic  reference  case.  Since  component  uncertainty  creates  a  more  difficult  receiver 
evaluation  problem,  it  is  useful  to  have  the  detection  performance  of  the  CKE  case  as  an 
upper  bound. 

7,3.  1  Receiver  Performance  -  Periodic  Time  Structure  (Known  Period,  Known 

Start). 


7.  3.  1.  1  CKE  (Component  Known  Exactly).  When  a  known  component 
recurs  in  time,  and  the  period  and  starting  time  of  the  component  are  known,  the  signal  is 


known  exactly.  This  is  then  an  SKE  (signal  known  exactly)  case  and  the  detectability  is 


Ec  is  the  energy  of  a  single  component  of  duration 
is  the  noise  power  per  unit  bandwidth 

Since  k  is  a  measure  of  time,  this  equation  shows  that  d  increases  linearly  with  time. 


7,  3.  1,  2  CKS  (component  known  statistically),  One  of  M  Orthogonal 
Components.  This  is  a  case  in  which  there  is  uncertainty  about  the  component,  but  the 
period  and  start  of  the  component  are  known.  This  is  one  of  M  orthogonal  signals,  and  one 
can  use  the  results  in  the  literature  to  obtain  the  detectability,  d  (Ref.  1).  At  time  t^  the 
total  signal  energy  is  k  E^  and  the  detectability  is 


d  =  f  n 


M 


(7.  11) 


where  M  is  the  number  of  orthogonal  components  in  the  component  ensemble.  By  varying 
M  an  idea  of  the  effect  of  component  uncertainty  on  detectability  can  be  obtained. 
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7.  3.  1.  3  Performance  of  the  Energy  Detector.  A  very  simple  detector 
which  is  not  optimum  is  the  power  or  energy  detector.  It  is  interesting  to  compare  the 
optimum  receiver  to  it,  in  order  to  see  how  much  performance  is  gained  by  the  more 
complex  optimum  receiver.  For  small  signal-to-noise  ratios,  the  performance  of  the 
energy  detector  is  (see  Appendix  E) 


7,  3.  1.  4  Effect  of  Component  Uncertainty.  The  effect  of  component 
uncertainty  is  shewn  in  Fig.  7.  17.  Using  Eqs.  7.  10  and  7.  11,  the  detectability  is  plotted  as 
a  function  of  time  for  no  component  uncertainty,  (CKE),  and  two  degrees  of  uncertainty, 

(CKS,  one  of  eight  and  one  of  100  orthogonal  components).  There  is  no  uncertainty  in  the 
time  structure  since  this  is  a  periodic  case  in  which  the  period  and  start  of  the  component  is 
known.  The  detectability  for  the  CKE  case  rises  linearly  with  time.  There  is  a  threshold 
effect  for  the  two  CKS  cases  plotted.  The  slope  of  the  detectability  curves  for  CKS 
approaches  the  slope  of  the  CKE  curve  after  the  receiver  has  obtained  sufficient  evidence  that 
a  particular  component  has  been  transmitted.  The  effect  of  component  uncertainty  is  a 
rather  mild  function  of  M  in  that  the  vertical  displacement  of  the  CKS  from  the  CKE  curve 
is  fnM  for  large  processing  times.  If  one  compares  the  detectabi.ity  of  the  CKE  and  CKS 
case,  the  ratio  eventually  approaches  unity.  In  either  case,  the  CKE  curve  provides  a  useful 
upper  bound  on  detectability. 

7.  3.  1.  5  Performance  of  a  ’Receiver  That  Does  Not  Utilize  Repeat¬ 
ability  of  a  Component.  The  optimum  receiver  for  M  orthogonal  components,  whose 
performance  is  given  by  Eq.  7.  11,  would  look  as  though  it  learned''  which  component  is 
being  sent  if  it  had  been  realized  with  an  adaptive  realization.  Let  us  now  consider  the 
performance  of  a  suboptimum  receiver  that  is  optimum  for  a  component  duration  but  which 
does  not  utilize  what  it  has  "learned"  about  the  component  to  process  subsequent  information. 
In  other  words,  at  the  start  of  each  occurrence  of  the  periodic  component  the  receiver 
anticipates  one  of  M  orthogonal  components  and  it  can  use  no  component  information  obtain 
from  the  previous  observations.  The  detectability  for  each  interval  T^  (a  component 
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duration)  is  then 
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and  the  detectability  at  time  is  given  by 


d  -  k  f  n 


(7.  13) 


The  performance  equation  of  this  suboptimum  receiver  differs  from  that  of  the  optimum 

receiver  in  the  argument  of  the  exponential.  In  Eq.  7.  13  the  argument  of  the  exponential  is 
2E  < 

simply  -~N.-  ,  a  quantity  associated  with  a  time  interval  equal  to  a  component  duration, 

o 

The  variable  k,  representing  time,  is  outside  of  the  logarithm  and  so  the  detectability 
eventually  rises  linearly  with  time  although  locally  there  are  exponential  segments.  In  the 
case  of  the  optimum  receiver,  the  time  variable,  k,  appears  in  the  exponential  of  Eq.  7.  1 
which  gives  rise  to  the  knee  in  the  detectability  curve  for  the  optimum  receiver.  A 
comparison  of  the  detectability  of  the  optimum  receiver,  which  makes  use  of  what  has  been 
"lean  ed”  about  the  component  sent,  with  the  suboptimum  receiver,  which  does  not,  is 
shown  in  Fig.  7.  13. 

7.  3,  1,  G  Comparison  of  the  Optimum  Receiver  with  the  Energy  Detector. 
In  Fig.  7.  19  the  performance  of  the  optimum  receiver  for  one  of  eight  orthognal  components 
is  compared  .vith  the  performance  of  the  energy  detector.  Once  past  the  "threshold,  "  the 
detectability  of  the  optimum  receiver  increases  rapidly  o”cr  the  energy  detector. 

7.  3.  2  Receiver  Performance,  Synchronous-- Poisson  Time  Structure,  (Common 
Component  Duration).  In  the  previous  section  receiver  performance  was  obtained  lor  detecting 
a  component  generated  by  a  periodic  triggering  process.  In  this  section,  the  Synchronous- 
Poisson  triggering  process  is  considered.  That  is,  the  probability  that  a  component  will 
occur  in  a  synchronous  interval  is  e,  the  probability  that  it  will  not  occur  is  1-e,  and  the 
occurrences  are  independent  from  one  interval  to  another.  In  the  Synchronous- Poisson 
Time  Structure  v  is  also  the  duty  factor  and  the  average  signal  energy  in  t  seconds  is  i-kE  . 

K  C 

Most  of  the  ROC  curves  presented  in  this  section  were  obtained  by  using  the 
digital  computer  as  an  experimental  tool.  This  is  an  approximate  but  useful  technique.  The 


Comparison  of  optimum  and  a  suboptimum  receiver  that  ignores 
component  identification  information.  Periodic  Time  Structure. 


or  performance, 
Time  Structure. 
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performance  of  the  optimum  receiver  for  CKE  will  occupy  much  of  this  section.  Comparing 
t his  performance  with  the  performance  where  the  occurrence  times  of  the  component  are 
known  exactly  shows  i he  effect  of  the  Synchronous- Poisson  Time  Structure  on  detectability. 
Also  the  CKE  case  puts  an  upper  bound  on  performance  when  there  is  component  uncertainty. 

7.  3.  2.  1  CKE  (Component  Known  Exactly).  When  the  component  is 
known  exactly  and  the  time  structure  is  Synchronous- Poisson,  the  optimum  receiver  cross¬ 
correlates  the  input  observation  with  the  component  waveform  and  subtracts  a  bias.  This  is 
fed  into  a  "r  nonlinearity  and  its  output  integrated.  A  block  diagram  of  this  receiver  was 
shown  in  Fig.  5.  12  b.  The  performance  of  the  optimum  receiver  for  the  case  of  a  component 

known  exactly  was  experimentally  determined  on  the  digital  computer  for  values  of  v  (duty 
2E 

factor)  and  ■  -  c  shown  in  Table  7.  1.  For  each  set  of  parameters,  500  simulation  runs 
N 

o 


TABLE  7.  1 


VALUES  OF  PARAMETERS  RUN 
CKE,  SYNCHRONOUS -POISSON  TIME  STRUCTURE 


2  E 

c 

N 

o 


.  0125 
.  0707 
.  0707 
.  1 
.  1 
.  I 
.  1 
.  1 
.  1 

.  1414 
.  1414 
.  2 


1 

2 

4 

4 

.  02 

1 

1.  3 

O 

c 

4 

2 

4 
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were  made  on  the  digital  computer  to  determine  the  ROC.  The  duration  of  a  run  depended  on 

2E  , 

the  particular  set  of  parameters.  For  example,  for  r  .  1  and  -r—  1.  a  run  lasted  1000 

IN 

o 

times  a  component  duration.  The  probability  distribution  of  the  optimum  receiver  output  (the 

likelihood  ratio)  was  obtained  for  several  points  in  time  under  both  hyptheses,  SN  and  N.  Time 

is  indexed  by  k,  the  number  of  synchronous  intervals.  From  the  probability  distributions  of  the 

receiver  output  the  ROC  was  obtained.  A  normal  approximation  to  the  data  points  was  made. 

Further  details  on  the  computer  simulation  are  discussed  in  Appendix  D. 

The  ROC's  for  the  parameters  listed  in  Table  7.  1  are  presented  in  Figs.  7.  20  through 

2F  _ 

7.  30  For  a  given  set  of  parameters,  r  and  -r —  ,  one  can  see  from  the  ROC's  how 

is 

o 

detectability  builds  in  time  as  k  increases.  It  is  easier  to  show  this  effect  if  we  read  the  ROC 
along  the  negative  diagonal  (i.  e.  ,  read  the  ROC  where  the  probability  of  each  of  the  two 
possible  types  of  errors  are  equal)  and  plot  this  detectability,  d,  as  a  function  of  time.  This 
has  been  done  in  Figs.  7.  31  through  7.  33  for  the  parameters  listed  in  Table  7.  1,  except  for 
2E  , 

v  =  .0125  and  — —  1.  From  these  curves  one  can  see  that  detectability  is  nearly  a  linear 

No 

function  of  time.  In  Fig.  7.  31  detectability,  d,  is  plotted  as  a  function  of  time  for  v  .  1 

2E  2  F 

c  c 

and —  =  .02,  1,  1.3,  2,  and  4.  As  —  increases,  the  slope  ol  the  curves  increase,  as 
o  o 

one  would  expect.  In  Figs.  7.  32  and  7.  33  detectability  is  plotted  versus  time  with  the  duty 

factor,  v,  as  a  parameter.  These  curves  are  also  nearly  linear  and  increase  in  slope  as  the 

duty  factor  increases.  Using  this  data,  the  effect  of  the  Synchronous -Poisson  Time  Structure 

and  component  uncertainty  on  detectability  will  be  investigated  in  subsequent  sections. 

7,  3.  2.  2  CKS  (One  of  Fight  Orthogonal  Components).  ROC  curves  are 

2  E  , 

plotted  in  Fig.  7.  34  for  the  case  of  one  of  eight  orthogonal  components  for  v  .1,  — ^ —  1, 

o 

and  k  100,  250,  500,  750,  and  1000.  The  data  for  these  ROC  curves  was  obtained  from  the 

receiver  simulation  displayed  in  Section  7.2.  These  ROC's  were  obtained  from  100  runs 

rather  than  the  500  runs  for  the  ROC's  of  the  CKE  case. 

7.  3.  2.  3  Effect  of  Component  Uncertainty.  A  preliminary  idea  of  the 

effect  of  component  uncertainty  on  receiver  performance  for  the  Synchronous- Poisson  Time 

2  E 

Structure  is  obtained  by  comparing  the  CKE  and  CKS  curves  for  r  .1,  —  1. 

o 

This  comparison  is  made  in  Fig.  7.  35  in  which  the  detectability  is  plotted  as  a  function  of  time. 
The  CKS  curve  exhibits  a  threshold  effect.  After  approximately  k  =  100,  the  detectability 
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Fipr.  7.20.  ROC  for  optimum  receiver,  CKE,  Synchronous-Poisson  Time  Structure, 
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Fig.  7.26.  ROC  for  optimum  receiver,  CKE,  Synchronous-Poisson  Time  Structure, 
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Fi^.  7.29.  ROC  for  optimum  receiver,  CKE,  Synchi'onous- Poisson  Time  Structure, 

2E 

=  -1414. 


Fig.  7.31.  Detectability  vs.  time,  optimum  adaptive  receiver.  Synchronous  -  Poisson 
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rises  almost  linearly.  The  slow  rise  in  cl,  below  k  -  100,  occurs  during  the  time  when  the 
recei'.er  is  "learning"  which  component  is  being  sent.  The  effect  of  component  uncertainty 
on  receiver  performance  appears  to  be  relatively  small  once  a  sufficient  processing  time 
has  elapsed.  There  is  undoubtedly  a  tradeoff  between  component  uncertainty  and  the  time  it 
takes  for  detectability  to  reach  a  constant  slope.  These  effects  are  similar  to  those  observed 
in  the  periocuc  case  shown  in  fig.  7.  17.  The  tilt  in  the  ROC  curves  for  high  k  values  and  the 
fact  that  the  slope  of  the  CKS  curve  in  Fig.  7.  35  does  not  quite  approach  the  slope  for  the  CKE 
curve  may  be-  due  to  the  smaller  number  of  runs  (100)  used  for  the  CKS  data  as  compared  to 
the  500  runs  used  for  the  CKF  curves.  This  analysis  is  only  the  start  of  a  study  of  the  effect 
of  component  uncertainty  on  detectability. 

7.  3.  2.  4  Effect  of  the  Synchronous- Poisson  Time  Structure  on 
Detectability.  The  CKE  is  an  important  case.  The  performance  of  the  optimum  receiver, 
when  the  component  is  known  exactly,  puts  an  upper  bound  on  attainable  performance  when 
there  is  initial  component  uncertainty.  In  other  words,  the  performance  of  the  optimum 
adaptive  receiver  designed  for  a  relatively  known  component  can  never  exceed  the  performance 
of  the  optimum  receiver  designed  for  a  component  known  exactly  even  after  the  adaptive 
receiver  has  "learned"  which  component  is  being  sent.  Even  then,  the  receiver  is  still 
faced  with  uncertain  component  arrival  times.  We  now  wish  to  investigate  the  effect  of  the 
uncertainty  in  component  arrival  times  on  the  detection  performance  of  the  optimum  receiver. 
To  do  this  we  will  need  to  know  the  performance  of  an  optimum  receiver  had  the  arrival  times 
been  known  exactly. 

When  the  component  and  arrival  times  are  known  exactly,  the  optimum  receiver  is 
one  which  gates  on  only  when  a  component  is  known  to  occur,  and  at  those  times  crosscor¬ 
relates  the  input  observation  with  the  component  waveform  and  subtracts  a  bias  term 
proportional  to  the  component  energy.  These  outputs  are  then  integrated  to  form  the  detection 
output.  Although  the  signal  is  known  exactly  in  any  given  transmission,  the  number  of 
components  that  occur  in  an  interval,  (0,  t^)  varies  from  one  transmission  to  the  next.  In 
fact,  the  number  of  components  that  occur  is  described  by  the  binomial  distribution.  The 
detection  performance  is  then  a  performance  averaged  over  the  various  number  of  components 


that  could  occur. 
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This  case  was  simulated  on  t he  digital  computer  for  r  .  1  and  -ry —  1,  2,4,  and 

o 

the  resulting  ROC's  arc  plotted  in  Figs.  7.  36  through  7.  38.  The  detectability,  d,  in  read  off 

these  curves  along  the  negative  diagonal  and  |  lotted  as  a  function  of  time.  Ibis  is  shown  in 

2E  . 

Fig.  7.  39  for  i>  =  .  1,  and  c  =  1,  2,  and  4. 

o 

The  average  number  of  components  that  occur  in  the  interval  (0,  tj.)  is  ek.  If  the 
actual  number  of  components  that  occurred  on  each  transmission  were  equal  to  the  average 
number,  the  detectability  would  be  given  simply  by 


2F 

d  rk-j^—  (7.  14) 

o 

This  analytical  approximation  is  plotted  in  Fig.  7.  39  along  with  the  experimental  curve. 

Both  the  analytical  equation  and  the  curve  that  results  from  the  experimental  runs  are 

approximations  to  the  true  curve.  The  agreement  between  the  two  approximations  is  best 
2  E  , 

for  -yr —  =  1.  The  simplicity  of  Eq.  7.  14  makes  it  a  useful  rule  of  thumb  equation  for  the 
o 

performance  of  a  receiver  which  knows  the  component  arrival  times  exactly. 

The  analytical  equation  for  detectability  for  the  CKE,  known  arrival  times,  case  is 

compared  with  the  detectability  for  the  CKE,  Synchronous- Poisson  Time  Structure  in  Fig.  7.  40. 

2E  , 

These  performance  curves  are  shown  fur  r  =  .  1  and  -rr~  1,2,4.  The  difference  in  the 

IN 

o 

detection  performance  is  due  to  the  uncertain  component  arrival  times.  This  shows  that 

even  when  the  component  is  known  exactly,  a  fairly  high  price  must  be  paid  in  the  detectability 

by  even  the  optimum  receiver  when  the  recurrence  times  of  the  component  are  this  uncertain. 

2  E  , 

For  example,  when  1,  for  the  same  detectability,  signal  processing  time  must  be 

o 

increased  6.  85  times  that  required  if  the  component  recurrence  times  tire  known  exactly. 

2  E  2E  > 

For  — - —  =  2,  it  is  5.7  times  longer  and  for  . .  4  it  is  about  3.  4  times  longer.  Thus, 

O  O 

it  is  at  low  component  signal-to-noise  ratios  where  component  recui  ren-e  time  uncertainties 
affect  detectability  the  greatest. 

2E  , 

Figure  7.  41  shows  the  same  comparison  for  -yy —  2,  and  r  -  .0707,  .  1,  and  .  1414. 

o 

For  r  =  .0707,  an  increase  in  processing  time  of  about  6.  4  limes  longer  is  required,  in  order 
to  attain  the  same  detectability,  than  would  be  required  if  the  component  recurrence  times 
were  known  exactly.  For  e  .1,  it  is  5.67  and  for  i>  -  .  1414  it  is  4.74.  These  curves 
indicate  that  component  recurrence  time  uncertainty  affects  detectability  the  most  at  low 
duty  factors. 
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Fig.  7.38.  ROC  for  optimum  receiver,  CKE,  arrival  times  known  exactly, 
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=  4,  v  =  .  1. 


CKE.  Synchronous- Poisson 
CKE.  Known  Arrival  Times 


and  CKE,  arrival  times  known  exactly. 
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In  general,  it  can  be  seen  that  the  effect  of  Synchronous- Poisson  time  uncertainty  on 

2  E 

detectability  is  substantial  for  the  range  of  values  01  duty  factor,  c,  and  -rr —  considered 

o 

here.  Component  recurrence  time  uncertainty,  of  the  Synchronous- Poisson  Time  Structure, 
degrades  performance  the  most  at  low  component  signal-to-ncise  ratios  and  low  duty  factors. 


7.  3.  2,  5  Comparison  of  the  Performance  of  the  Optimum  Receiver  with 

the  Energy  Detector  (One  of  Eight  Orthogonal  Components).  The  optimum  adaptive  receiver 

has  already  been  discussed  for  t he  case  of  one  of  eight  orthogonal  components  (see  Section  7.  2). 

It  uses  a  temporary  memory  for  storing  probabilities  of  each  of  the  eight  components  and 

continually  updates  these  probabilities  with  new  information  obtained  in  subsequent  observations. 

Oil  the  other  hand,  the  energy  detect  >r  has  one  square-law  nonlinearity  followed  by  an 

integrator.  The  energy  detector  also  has  no  classification  capability.  It  is  interesting  to 

see  how  the  detection  performance  of  such  a  limited  memory  receiver  compares  with  the 

performance  of  the  optimum  receiver.  The  performance  of  the  energy  detector  for  the 

Synchronous -Poisson  time  uncertainty  signais  has  been  derived  in  Appendix  E  for  one  of  M 

2E  , 

orthogonal  components,  and  lor  small  it  is 
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(7.  15) 
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The  performance  of  the  energy  detector  is  degraded  by  a  factor  of  r  which  is  the  duty 
factor  squared,  and  by  the  component  uncertainty,  expressed  by  M.  Figure  7.42  is  a 
comparison  of  the  detectability  of  the  optimum  receiver  and  the  energy  detector.  After 
about  k  100.  the  detectability  of  the  optimum  receiver  increases  rapidly  over  the  energy 
detector.  This  shows  the  value  of  the  optimal  use  of  the  receiver  memory. 


7.  3.  2.  G  Effect  of  the  "n  Nonlinearity"  On  Receiver  Performance. 

When  the  design  of  the  optimum  receiver  for  the  Synchronous -Poisson  Time  Structure  was 

compared  with  the  optimum  receiver  for  the  Periodic  Time  Structure,  many  striking 

similarities  were  found  (see  Section  5.  4).  In  fact ,  the  primary  difference  was  the  presence 

of  a  "r  nonlinearity"  in  the  receiver  designed  for  the  Synchronous- Poisson  Time  Structure 

C  •  C 

(see  Fig.  5.  13b).  In  the  optimum  receiver  for  the  Periodic  Time  Structure,  x.  •  C - ^ — 


144 


Ui 

rj 


i  v. 


o 

o 


Cd 

r- 

ZL 

tz 


_L 

OJ 


J _ I _ J _ l 

t—  CD  »0  TT 

p  ‘X)I|K|T2)0010a 


JL 

ro 


1 


O 


o 


00 


Comparison  of  optimum  receiver  and  energy  detector  perf./i  mance. 
CKS,  (one  of  eight  orthogonal  components). 
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was  circulated  through  the  delay  forming 
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Since  this  can  be  written  as 
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one  can  see  that  for  the  periodic  case  tin  observations  themselves  could  be  simply  added  in 

k 

synchronous  intervals  and  this  sum,  _  x.,  correlated  with  the  component  C.  In  the  optimum 

i- 1  1 

receiver  for  the  Synchronous- Poisson  Time  Structure,  however,  the  observations  must  first 
be  correlated  with,  the  component,  passed  through  a  r  nonlinearity  and  then  summed.  A 
natural  question  arises  as  to  how  important  this  nonlinearity  is.  Since  the  input  to  the 
nonlinearity  is  a  random  variable,  more  than  just  the  shape  of  the  nonlinearity  must  be 
examiiud.  In  this  section  the  effect  on  detectability  of  the  v  nonlinearity  will  be  studied  by 
evaluation  the  detection  performances  of  two  receivers.  These  two  receivers  are:  (1)  the 
optimum  receiver  for  CKF,  Synchronous- Poisson  Time  Structure,  (Fig.  5.  13b)  and  (2) 
a  suboptimum  receiver  for  the  CKE,  Synchronous- Poisson  T  me  Structure  (Fig.  5.  13a). 

The  first  receiver  is  optimum  and  includes  the  r  nonlinearity  and  the  second  receiver  (which 
is  suboptimum  for  the  synchronous  case  but  happens  to  be  optimum  for  the  periodic  case) 
does  net  have  a  nonlinearity.  The  optimum  receiver  has  already  been  evaluated  using 
Monte  Carlo  techniques.  The  suboptimum  receiver  has  been  evaluated  analytically  and  the 
derivation  of  this  result  is  presented  in  Appendix  F.  The  performance  of  this  suboptimum 
receiver  is 


2  e 

c!  =  r  k  (7.  17) 

o 

The  performance  of  this  receiver  is  affected  by  r  squared.  One  r  accounts  for  the  fact  that 
signal  energy  is  reduced  by  i>  and  the  other  n  accounts  for  the  uncertainty  in  recurrence  times 
of  components. 

In  Figs.  7.  43  through  7.  45  the  performance  of  the  optimum  and  suboptimum  receiver 
are  compared.  The  performance  curves  for  the  optimum  receiver  are  obtained  from  Monte 
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Carlo  runs  (sue  Figs.  7,  20  through  7.  30),  and  the  performance  of  the  suboptimum  receiver 

is  given  by  Kip  7.  17.  Let  us  discuss  each  of  these  three  figures.  In  Fig.  7.  43  detectability 

2  E  , 

vs.  time  is  plotted  for  the  two  receivers  tor  i  .  1,  , .  ^  1,  2,  and  4.  The  increased 

o 

processing  time  necessary  for  the  suboptimum  rece  iver  to  reach  the  same  level  of  detection 
performance  as  the  optimum  receiver  can  be  detirmined  by  comparing  the  performance  of 
the  two  receivers  at  a  constant  d.  The  ratio  of  optimum  receiver  processing  time  to  sub¬ 
optimum  receiver  processing  time  required  to  reach  the  same  detectability  is: 


2  F 

c 

N 

o 


Ratio  of  optimum  to 
suboptimum  receiver 
processing  time. 


1 


1.  46 


2  1. 76 

4  2. 25 


This  data  shows  that  the  importance  of  t hi  r  nonlinearity  increases  as 


2  E 


c 


N 


increases. 


o 

In  Fig.  7.  44  the  performance  of  the  optimum  and  suboptimum  receivers  are 


2  K  , 

plotted  for  -  2  and  r  .0707.  .  1,  and  .  1414.  In  Fig.  7.  45  similar  data  is  presented 

n  t  O 

L  L  t 

for  -  4  and  r  =  .0707,  .  1,  .  1414,  and  .2.  The  ratio  of  processing  times  required  by 

o 

the  suboptimum  and  optimum  receivers  to  reach  the  same  detectability  is  plotted  in  Figs. 

7.  46  and  7.  47.  The  ratio  of  processing  times  for  r  =  1  is  one  since  then  the  two  receivers 
are  identical.  It  is  difficult  to  obtain  data  for  very  low  values  of  r  because  of  the  longer  runs 
required  on  the  digital  computer.  Figures  7.  46  and  7.47  show  that  the  importance  of  the  v 
nonlinearity  increases  as  the  duty  factor,  n,  decreases. 

In  conclusion,  the  importance  of  the  r  nonlineariiv  in  the  ootimum  receiver  increases 


as 


increases  and  the  duty  factor  decreases. 
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7.  4  Summary 

In  Ibis  chapter  an  adaptive  receiver  realization  was  simulated  on  a  digital  computer 
for  one  of  eight  orthogonal  components,  Synchronous- Poisson  Time  Structure,  Individual 
runs  of  the  detection  and  classification  outputs  as  a  function  of  time  were  displayed  to  illustrate 
how  such  a  receiver  operates.  However,  it  is  difficult  to  judge  receiver  performance  from 
the  individual  runs. 

The  performai  ce  of  the  optimum  receiver  for  a  CKF,  Synchronous-Poisson  Time 

Structure  was  evaluated  experimentally  on  the  digital  computer  for  various  values  of  the 

2I-, 

parameters  u  (duty  factor),  — ^ —  ,  and  k  (time).  The  detectability  builds  up  in  time  in 

o 

a  nearly  linear  fashion.  The  signal  detectability  is  reduced  when  the  arrival  times  are 

2F 

uncertain.  For  example,  for  — ^ —  -  1  and  a  duty  factor  of  10'#,  the  processing  time 

o 

required  to  reach  a  specified  detectability  is  0.  85  times  longer  than  would  be  required  if 
the  component  recurrence  times  were  known  exactly.  This  extra  required  pioeessing  time 
increases  as  component  signal-to-noise  ratio  and  duty  factor  decrease. 

By  comparing  the  detectability  for  one  of  eight  orthogonal  components  with  the  CKK 
case,  it  was  found  that  component  uncertainty  affects  detectability  in  a  rather  mild  manner 
after  sufficient  processing  time  has  elapsed.  This  effect  is  similar  to  that  which  occurs 
when  the  component  recurs  periodically.  The  performance  of  the  optimum  receiver  fo:  one 
of  eight  orthogonal  components  was  compared  with  the  energy  detector  to  show  the  value  of 
the  optimal  use  of  the  receiver  memory. 

The  importance  of  the  r  nonlinearity  in  the  optimum  receiver  for  the  CKK,  Synchronous- 

Poisson  Time  Structure  was  investigated  by  evaluating  a  suboptimum  receiver  which  does  not 

contain  the  v  nonlinearity.  It  was  found  that  the  importance  of  the  r  nonlinearity  increases  as 
2Ee 

increases  and  the  duty  factor  decreases, 
o 


CHAPTER  VIII 


SUMMARY 


8.  1  Conclusions 

An  exciting  now  area  of  research  is  the  application  of  adaptive  processing  techniques 
to  the  problem  of  detecting  signals  in  noise.  Adaptive  techniques  have  been  considered  by 
several  researchers  in  regard  to  detecting  an  unknown,  but  fixed,  waveform  that  recurs 
randomly  in  time.  For  such  a  detection  situation  it  seems  quite  natural  to  postulate  an 
adaptive  device  to  "learn"  this  waveform  in  order  to  aid  the  detection  process.  However, 
a  basic  contribution  of  this  study  has  been  to  show  how  the  theory  of  signal  detectability  can 
be  extended  to  include  techniques  of  optimum  receiver  design  for  problems  of  this  type. 

Most  past  work  in  detection  theory  considers  signals  whose  time  structure  is 
periodic.  In  the  usual  radar  problem,  the  time  structure  is  basically  periodic  of  known 
repetition  frequency  but  unknown  start  of  the  period  and  parameters  such  as  amplitude  are 
assumed  unknown.  A  significant  difference  in  this  study  is  in  the  consideration  of  the 
detection  of  signals  in  noise  in  which  the  time  structure  is  nonperiodic. 

A  rather  general  problem  is  considered  to  which  adaptive  techniques  have  been 
applied  by  others.  A  fixed  waveform,  called  a  component,  is  initially  uncertain  but 
learnable.  One  of  b  components  is  selected  prior  to  the  start  of  transmission  and  the 
same  component  recurs  at  uncertain  times  which  are  unlearnable.  The  receiver  must  be 
capable  of  detecting  such  a  recurrence  phenomenon  in  noise.  This  problem  is  formulated  as 
an  over-all  optimization  problem  in  detection  theory  rather  than  as  a  problem  in  which  an 
adaptive  receiver  is  postulated.  Detection  theory  provides  a  mathematical  model  in  which 
initial  knowledge  about  component  and  recurrence  time  uncertainties  are  expressed  in  terms 
of  a  priori  probabilities.  The  component  is  uncertain  in  the  sense  that  one  of  a  finite 
number  of  b  components  is  selected  for  transmission.  The  recurrence-time  uncertainties 
studied  are  of  three  basic  types:  Periodic,  Synchronous-Poisson,  and  a  Sporadic-Poisson 
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Time  Structure.  The  basic  philosophy  is  to  design  an  optimum  receiver  which  makes  the 
best  decision  as  to  presence  or  absence  of  the  recurrence  phenomenon  in  the  entire 

observation.  X.  ,  and  to  realize  this  optimum  receiver  with  an  equivalent  adaptive  realization. 

K 

From  detection  theory  it  is  known  that  the  optimum  receiver  forms  the  likelihood 
ratio,  f ( X  ).  of  that  observation.  If  the  receiver  is  to  run  in  time,  it  must  keep  forming 
the  likelihood  ratio  of  the  entire  observation  as  k  increases.  In  Chapter  III  it  was  shown 
how  this  optimum  receiver  could  be  realized  in  an  alternate  equivalent  form.  This  is  a  form 
in  which  the  likelih  >od  ratio  of  the  observation,  X  is  realized  in  a  sequential  manner.  The 
operations  performed  by  the  sequential  and  nonsequential  receivers  appear  quite  different 
although  the  receivers  are  equivalent  for  detection  purposes.  The  sequential  receiver 
is  called  an  adaptive  realization  because  of  the  explicit  manner  in  which  it  updates  knowledge1 
of  the  situation.  A  classification  output,  which  is  a  set  of  updated  probabilities,  can  be 
conveniently  made  available. 

A  basic  difficulty  in  receiver  design  emerges  when  considering  signals  with  a 
nonperiodic  time  structure  which  does  not  appear  in  the  classical  periodic  cases.  This  is 
the  problem  of  providing  sufficient  receiver  memory  to  store  probabilities  of  signals  in  an 
ensemble  that  grows  rapidly  in  time.  To  design  a  practical  optimum  receiver,  it  was  found 
necessary  to  develop  an  indirect  description  of  the  signal  ensemble.  In  an  indirect  description, 
the  signal  ensemble  is  described  in  terms  of  a  component  ensemble  and  a  time  structure. 
Optimum  adaptive  receivers  were  designed  for  the  Sporadic- Poisson,  Synchronous-Poisson, 
and  Periodic  Time  Structures  using  this  technique  and  the  sequential  realization. 

The  proper  use  and  updating  of  the  contents  of  the  temporary  memory  for  the 
adaptive  realizations  are  specified  by  the  design  procedure.  When  the  time  structure 
is  periodic,  the  starting  times  of  the  component  are  known,  and  the  possible  components 
are  of  common  duration,  the  temporary  memory  of  the  optimum  receiver  stores  and  sums  the 
input  waveshape  to  the  receiver.  If  the  period  is  unknown  or  if  the  time  structure  is 
Synchronous-Poisson.  then  the  temporary  memory  stores  a  more  abstract  quantity  such  as 
an  updated  probability  of  each  possible  period  or  component.  Finally,  in  the  Sporadic- 
Poisson  Time  Structure,  the  adaptive  realization  stores  and  continually  updates  component 
identification  and  local  component  positional  information  in  its  temporary  memory.  The 
updating  procc.  es  have  been  formalized  and  presented. 
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An  adaptive  receiver  realization  was  simulated  on  the  digital  computer,  and  its 
operation  was  displayed  for  a  number  of  runs.  These  displays  show  the  "adaptive"  nature  of 
this  type  of  realization.  However,  it  was  found  difficult  to  judge  receiver  performance  from 
any  single  run.  Instead,  performance  is  presented  in  terms  of  the  ROC  (receiver  operating 
cha  racteristic). 


This  study  also  contributes  to  the  understanding  of  the  effect  of  time  uncertainty  on 

detectability.  Since  the  adaptive  realization  provides  a  receiver  of  manageable  form,  it 

becomes  feasible  to  evaluate  its  performance.  Evaluation  of  the  performance  of  the  optimum 

receiver  for  a  particular  time  structure  then  sets  an  upper  bound  on  the  performance  of  any 

other  receiver  in  that  same  environment.  The  effect  of  Synchronous- Poisson  Time  Structure 

uncertainty  on  detectability  for  the  case  of  a  component  known  exactly  (CKE)  was  investigated. 

This  is  an  important  first  case.  Even  when  the  component  is  initially  uncertain  and  lias  been 

"learned"  the  performance  of  the  optimum  receiver  for  that  case  cannot  exceed  the  CKE  case. 

The  performance  of  the  optimum  receiver  for  the  CKE,  Synchronous- Poisson  Time  Structure, 

2E, 

was  presented  in  terms  of  the  ROC  for  various  values  of  the  average  duty  factor,  , 


o 


and  time.  The  detectability,  d,  builds  almost  linearly  in  time. 

The  price  in  performance  that  must  be  paid  by  even  the  optimum  receiver,  because 
component  arrival  times  are  not  known  exactly,  was  investigated.  For  example,  for  a 


2E  , 

-yr-  1  and  an  average  duty  factor  of  10^,  the  receiver  processing  time  required  to  reach 
o 

the  same  detectability  is  about  6.  85  times  longer  than  would  be  required  if  component  recur¬ 
rence  times  were  known  exactly.  This  extra  processing  time  required  is  a  decreasing 
2E  , 

function  of  —  and  a  decreasing  function  of  average  duty  factor.  These  results  show  that 
o 

even  when  a  component  is  known  exactly,  the  effect  on  detectability  can  be  substantial. 

The  results  of  comparing  the  detectability  for  one  of  eight  orthogonal  components 
with  the  CKE.  Synchronous-Poisson  Time  Structure,  suggest  that  component  uncertainty 
affects  detectability  in  a  rather  mild  manner  after  a  sufficient  amount  of  time  has  elapsed. 
This  situation  is  similar  to  that  of  the  periodic  case.  The  performance  of  the  optimum 
receiver  for  one  of  eight  orthogonal  components  was  compared  with  the  energy  detector  to 
show  its  superior  performance. 
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The  importance  of  storing  and  updating  probability  or  likelihood  ratio  terms  in  the 

temporary  memory  for  the  optimum  receiver.  CKE,  Synchronous- Poisson  Time  Structure. 

was  investigated  by  comparing  its  performance  with  a  receiver  which  stores  and  modifies 

input  waveshape.  From  these  results  it  was  found  that  storing  probabilities  or  likelihood 

ratios  in  the  temporary  mi  r.ory  rather  than  input  waveshape  became  more  important  as 
2  E  2  E  , 

increased  and  the  average  duty  factor  decreased.  For  sample,  at  — —  2  and  an 

o  1  o 

average  duty  factor  of  .0707,  about  twice  as  much  processing  time  is  required  by  the 

receiver  that  circulates  input  waveshape  to  obtain  the  same  detectability  as  the  optimum 

receiver. 

8,  2  Fut ure_ Work 

There  arc  a  number  of  directions  in  which  future  work  can  go.  First,  the  effect  of 
time  uncertainty  on  detectability  has  just  begun.  Although  the  optimum  receiver  has  been 
designed,  its  actual  performance  in  terms  of  the  HOC  remains  to  be  determined.  The 
effect  of  the  Sporadic- Poisson  Time  Structure  and  component  uncertainties  on  detectability 
remains  to  be  investigated. 

Tne  problem  of  optimum  receiver  design  for  an  infinite  component  ensemble 
with  a  learnable  parameter  and  a  Synchronous- Poisson  or  Sporadic- Poisson  Time  Structure 
is  an  area  of  investigation.  At  present,  such  a  problem  could  be  attacked  in  an  approximate 
manner  by  representing  such  a  component  ensemble  as  finite  and  using  the  receiver  design 
techniques  presented  in  this  study. 

Another  area  of  investigation  is  the  design  of  optimum  receivers  for  learnable  time 
structures  which  are  initially  uncertain.  In  this  study  the  design  of  the  optimum  receiver  for 
detecting  a  recurrence  phenomenon  of  unknown  period  was  presented  and  this  could  be 
extended  to  more  complicated  time  structures. 

Three  basic  time  structures  have  been  considered:  the  Periodic,  Synehronous- 
Poisson,  and  Sporadic -Poisson.  The  extension  of  the  same  optimum  receiver  design 
approach  could  be  considered  for  many  other  types  of  time  uncertainty. 


APPENDIX  A 


OPTIMUM  ADAPTIVE  DECEIVED  REA  I  IZATIONS 
SPORADIC  -  POISSON  TIME  STRUCTURE 


A.  1  Rmi ! ization  II 

Tile  optimum  adaptive  recei ver  realized  in  Section  5.  1.  1  is  not  unique  A  slight 
modification  of  Realization  I  results  if  one  writes  the  joint  probability,  b.  .(k)  as 


(A.  1) 


where  b'.  (k)  is  the  probability  of  the  jth  component  sample  under  the  condition  that  the  ith 

1 1 J 

component  and  SN'  are  present  and  that  k  observations  have  been  taken.  Writing  b.  (k) 

J 

in  this  manner  emphasizes  the  classification  output,  p^(c'lSN).  Substituting  Eq.  A.  1  into 
Eq.  5.  18  for  the  sequential  average  likelihood  ratio  results  in 


f(Vxk-i> 


1=1 


p  j(c'lSN) 
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IT.  n(k- 1)  4  IT.  ( k - 1 ) 
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*  x  IT.  . ( k - 1 ) f ( x ,  Is.  c.  .) 
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k'°k  '■i.j' 


(A.  2) 


where  p  (C'ISN)  has  been  factored  out.  We  can  therefore  define  a  conditional  sequential 
K 

likelihood  ratio,  f(.\j ,  IX  ^ ,  C 1 ) 


“Xklxk-i,c‘>  - 
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The  prec  eding  equation  gives  the  likelihood  ratio  of  tin  observation  assuming  the  ith 

component  lias  been  recurrent.  Substituting  Keg  A.  3  in;  «  Kq.  A.  2  results  in  the  average 

sequential  likelihood  ratio,  f(.\  !X  ),  becoming 

K  K“  1 


'‘Wl1  1  |.k_1(C,lSSH(.vkIXt_|.Cl) 


The  ipdating  of  component  information  still  requires  equations  similar  to  Keg  5.  32 
through  5.  34.  II  one  makes  th  ■  substitution 


b.  .(k-1)  b'.  (K- l)p,  ,(c‘lSN) 

i.J  !,J  k-1 


and  factors  out  p  . (C'ltJN),  then  Kqs.  5.  32  through  5.  34  become 
K  “  l 
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for  j  -  2,  3, .  . .  ,  n. 


Instead  of  updating  products  of  the  form  b'.  .(k-l)i:.  ,(c'lSN),  b’.  .  ,(k-l)  and  p,  , ( C 1 

1  i,  j- 1  k-1  i ,  j- 1  k-1 


can  oe  updated  separately  by  noticing  that 
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Tilt'  updating  ul  component  mlormaiion  can  be  implemented  by  updating  ol  the  probability  cjI 
the  itli  component.  p^( C 1  i SN) .  and  updating  the  |)robability  of  the  jth  component  sample  given 
the  ith  component,  b'.  ^(k).  This  then  gives  an  alternative  realization  of  the  optimum  adaptive 
receiver.  The  design  equations  for  Realization  11  are  summarized  in  Table  A.  1. 


TABLK  A.  1 


BASIC  RLX'KIVKH  DKSION  KQUATIONS,  SPORADIC- POISSON  TIM  F  c-yorCTCRK 

RKA  1IZATION  II 


Optimum  Detection  Output 
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Component  Conditional  Sequential  Likelihood  Ratio 
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Classification  -  Component  Position 
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for  j  2,  3, .  .  .  ,  n. 


Classification  -  Component  Identification 
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A  block  diagram  o!  the  realization  is  illustrated  in  Fig.  A.  1.  This  realization  is 

basically  the  same  as  Realization  1  in  Section  5.  1.  1.  In  Realization  II,  however,  the  informa- 

t.i;  n  regarding  which  component  is  present  is  kept  in  a  temporary  memory  separate  from  the 

updated  compoimnt  positional  information.  This  mean:  that  Realization  II  requires  a  greater 

amount  of  temporary  memory.  On  the  other  hand,  Realization  I  requires  a  summer, 
l-i 

b.  .(m)  to  calculate  the  component  classification  information. 

j-0  l,J 


A.  2  Realization  III 


There  is  a  third  adaptive  receiver  realization  which  is  a  "b”  channel  receiver  in 

which  each  channel  "looks"  for  one  of  the  components.  For  a  finite  number  of  signals  in 

the  signal  ensemble  the  integral  in  Eq.  5.  1  becomes  a  sum  so  that  the  likelihood  ratio  of  the 

observation  X,  is 
k 

f(X,  )  =  ^  f(X.  Is)p  (sISN)  (A.  13) 

se  S 

Now  the  signal  space,  S,  can  be  partitioned  into  b  disjoint  subspaces,  S.,  Each  S.  subspace 
contains  all  those  signals  that  might  result  from  the  ith  component  alone.  This  is  a  result  of 
the  restriction  that  a  given  component,  C1,  is  selected  and  fixed  at  the  beginning  of  each  long 
transmission.  Thus  Eq.  A.  13  can  be  written  as 

b 

f(X  )  =  s  v  f(X.  Is)p  (sIC1,  SN)p  (c'lSN)  (A.  14) 

k  i=i  seS.  k  0  0 

i 

where  by  definition  of  a  joint  probability,  p^(s  i SN)  has  been  written  as 

p  (sISN)  =  po(slc',SN)pu(ClISN)  (A.  15) 

First,  the  summation  in  Eq.  A.  14  is  carried  out  over  each  subspace,  S..  Since  p(j( C  I  SN)  is 
a  factor  for  each  sum  over  S.,  Eq.  A.  14  can  be  written  as 

i 

b 

f(X,  )  =  ^  p  (C1 1  SN)  N  f  (X  ls)p  (sIc'.SN)  (A.  16) 

K  .  «  O  «  K  O 

1=1  seS. 

\ 

or 

b 

f(X  IC:)  =  x  f (X ,  lc')p  (C1 ! SN)  (A.  17) 

K  .  ,  K  O 

1=  1 

Now  the  sum  over  the  space  S.  is  the  likelihood  ratio,  f(X,  1C1)  of  the  observation  X,  under  the 

*  l  k  k 

condition  the  ith  component  is  present.  In  other  words, 
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This  likelihood  ratio,  f(X^lc'),  can  in  turn  be  realized  in  a  sequential  fashion  for  each  of  the 
b  possible  components.  So 


f(Xklc')=  f(Xk_1IC,)l(.xkIXk_1,C1)  (A.  19) 

where  f(xk!Xk  j,Cl)  is  given  by  Eq.  A.  13  along  with  Eqs.  A.  9,  A.  10  and  A.  11.  The  class¬ 
ification  output  for  component  identification  is  given  by 

.  p  (c'lSN)f(X.  iC1) 

p  (CMSN)  — - - -  (A.  20) 

"V 

Table  A.  2  summarizes  the  design  equations.  This  realization  has  a  channel  for  each  of  the 
b  possible  components.  A  gross  block  diagram  of  one  channel  of  the  receiver,  Realization  III. 
is  shown  in  Fig.  A.  2.  In  this  realization  each  of  the  branches  calculates  the  likelihood  ratio 
of  the  entire  observation,  Xk,  under  the  condition  the  it h  component  is  being  sent.  The  out¬ 
puts  of  each  channel  are  then  weighted  by  the  a  priori  probabilities,  p(  (c'lSK),  of  the 
selection  of  each  of  the  components  and  these  a.  summed  to  form  the  likelihood  ratio,  f(X  ). 

K 

This  realization  looks  "less  adaptive"  since  p  ( C 1 1 SN)  is  not  explicitly  upda  <_d  at  each  step 
in  time.  It  differs  from  Realization  II  in  that  it  has  a  separate  chancel  for  each  of  the  possible 
components. 


TABLE  A.  2 

BASIC  RECEIVER  DESIGN  EQUATIONS,  SPORADIC-POISSON  TIME  STRUCTURE 

REALIZATION  III 


Optimum  Detection  Output 

b 

f(XR)  =  ^  f(XkICl)po(CllSN) 
i=  1 


(A.  18) 
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Component  Conditional  Likelihood  Ratio 


t(xklci)  =  f(xkllc,)f(xkixkl,cl) 


(A.  19) 


Component  Conditional  Sequential  Likelihood  Ratio 


'<Vxk 


(k-1)  +  b'.  (k- 1) 

0  i,n. 


1  -i>.  !' .  f  (x.  Is.  =  c.  ) 

i  l  k  k  i,l 


n. 

*  ■rll,'i.j-i(lt'1)‘<xklsk“:i,j) 

J  ^ 


(A.  3) 


Classification  -  Component  Position 


u-",: 


b’.  Q(k- 1)  +  b 


(k- 1)1 

l’ni  J 


((\lxk-i,c'» 


b'.  .(k) 

i.  1 


ipi,0(k-1)  *  b'i.n.(k-!]((Vsk‘ci,j) 
'<VXk.>'C'> 


(A.  9) 


(A.  10) 


b’  (k-l)f(x  Is  =  c  ) 
b\  .(k)  =  -  - - — - - 


i,  J 


nxkiXk-rc 


Classification  -  Component  Identification 


(A.  11) 


Pk(cMSN) 


Po(CiISN)f(XkICi) 


(A. 20) 


Men 
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Fig.  A.  2.  Adaptive  receiver  realization,  Sporadic-Poisson  Time  Structure, 

Eealization  III. 
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A  3  Realization  IV 

We  now  come  to  one  of  the  most  interesting  and  useful  1  ealizations.  The  rocoivei 
realizations  discussed  previously  are  adaptive  and  operate  in  an  intuitively  appealing  manner. 
A  simpler  sequential  realization  is  possible.  Let  us  begin  the  derivation  of  this  realization 
by  considering  the  likelihood  ratio  of  the  observation  j.  This  likelihood  ratio  is 


.  i.n. 
b  ’  i 


c. 


l,  n. 


I  (X 


\ 


\ 


V 


i,  n 

\ 


k-r  - 

1  srci,o  b2  Li,o  VrS.o 


f(xk-llsl's2 . Sk-l)|Jo(sl--S2’----Sk-lISN) 

(A.  21) 


Since  these  are  finite  sums,  the  order  of  summation  may  be  interchanged.  Leaving  the 
summations  with  respect  to  i  and  s  .  until  last,  one  can  write 

K  “  I 


C. 


f(x 


b 

\ 


l,  n. 


\ 


k-r 

1-1  VrS.o 


1,  n. 


srci,o 


c. 


i,  '>= 


i,  n. 


S2=ci,0  sk-2=ci,u 


f(Xk-l  lsl’ 


2’  ‘ 


k-r 


Po(VS2 . VlISN) 


(A. 22) 


Denoting  the  quantity  in  brackets  by 


i,  n. 

A  \  1 

Qs  (k- 1)  =  1 


l,  11. 


c. 


i,  n. 


<-l 


sfci,0  s2=ci,0  Sk-2  ci,0 


f  vXk-  1  lsl’s2**  •  -  ’  sk-l)po(sr  S2 . sk-lISN) 


v<»s 


i,  n. 


\ 


i 


Q.  (k- 1) 

1=1  Sk-fCi.O  k_1 


(A. 2d) 


Now,  the  likelihood  ratio  of  the  observation  X.  is  defined  to  be 

k 


c .  c .  c . 

,  i,  n.  i.  n.  i,  n. 
It  l  ii 


((X 


N  \ 


\ 


1  1  srci,0  s2  =  ci.O  Vci.O 


f  (Xk.j  ISj,s2 . ■sk.1)f  (xklsk)po(srS2 . SkISN) 


(A.  25) 
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and  by  definition  of  a  joint  probability 


p(,(sr S2 . VSN)  Po(sl’ S2 . Vi  SN)po(skisrs2 . \-l'SN)  (A'26) 


For  the  generator  processes  under  consideration 


po(sklsrs2 . sk-rSN)  p(sklsk-i’SN) 


(A. 27) 


the  stiite  of  the  signal  sample,  s^,  depends  only  on  the  state  of  the  previous  sample,  s^ 
Substituting  Eq.  A.  27  into  A.  26  results  in 


p»(sr S2 . skISN)  po(srs2 . ViISN)  pr(skisk-rSN) 


(A.  28) 


and  substituting  Ecp  A.  28  into  A.  25  gives 


c .  c .  c . 

1, 1l.  1,1).  1,11 

It  I  ’  1 


«xk)  =  ^  s_  I 

i=l  s,  =  c.  n  s  c  s  -c  L 

1  i,0  2  i,0  k  i,0 


S„  c  ,,  s,  =c  J- 


*2 . \-l)f(xk|sk} 


p(sklsk-l’  SN)p(/sr  s2 . Sk-1  ISN^| 


(A.  29) 


One  can  select  the  order  ol  summation  so  that  the  sum  over  s^  and  s^  ^  follows  the  sum 
over  Sj,S2>...,sk  ^ .  Also,  g(s^ls  ^ ,  SN)  can  be  factored  out  of  the  summation  over  the 
first  k-2  sums  and  factored  out  of  the  sum  over  the  first  k-1  sums.  Equation  A,  29 

can  be  written  then  as 


c.  c. 

b  1,ni  '• 1  j 

"V.-,  ‘W  s  r, 

k  i.O  k-1  i. 


p(sk,sk-rSN) 


c .  c . 
i,  n.  i,  n. 

i  i 

\  \ 


S1  Ci,0  S2  ‘‘i.O  Sk-2  Ci.O 


f(xk-ilsi'"2 . sk-!)po(srs2 . sk-r  SN) 


(A. 30) 
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Notice  that  the  multiple  sum  in  brackets  is  what  we  have  defined  in  Eq.  A.  23  as  Q  (k-1). 


Making  this  substitution,  Eq.  A.  30  becomes 


k-1 


c.  c. 

b  l-ni  l-ni 

f(xk)=l  1  1  (xklsk)  -  g(sls  SN)Q  (k-1).  (A. 31) 

1  1  VCi,0  Sk-l  =  Ci,0  k_1 


Now  in  a  mat  ner  completely  analagous  to  that  which  resulted  in  Eq.  A.  24,  one  can  write  ihe 

likelihood  ratio  of  the  observation  X,  as 

k 


f(X,  )  = 


b 

\ 


l,  n. 


\ 


-  Qs  (k> 

1=1  VCi,0  k 


(A. 32) 


Therefore  Eq.  A.  31  can  be  written  as 


c. 

i 

\  \ 


b  1  *  "i 


b  l’Mi 


i,  n. 


((X.)  =1  1  Q  (k)  =  _ 

i=1  VCi,0  k  1=1  VCi,0 


Sk-1  i,0 


(A. 33) 


By  inspecting  both  sides  of  Eq.  A.  33  it  can  be  seen  that  the  general  equation  for  updating 

Q  (k)  in  terms  of  Q  (k-1)  is  given  by 
s>:  &k 


i ,  n. 

\ 


i 


Qa  <k)  =  %'V  - 
k  sk-rci,o 


e<sklsk-l’SN')Qs 


(k-1) 


k-1 


(A. 34) 


We  now  want  the  updating  equation  for  each  state  that  s^  can  be  in.  Lei  us  use  the 
notation  Q  (k)  -  Q  .(k).  By  definition  of  the  Sporadic- Poisson  generator  process  as 

Vci,j 

given  by  Eqs.  4.  2  through  4.  5,  many  of  the  state  transitions  in  the  formal  sum  of  Eq.  A.  34 

are  zero.  For  s^  =  c.  q,  the  only  nonzero  values  of  g( s^  1  s^_ j ,  SN)  are  g(s^  =  c.  o'sk_i=Cj  q.  SN) 

=  1-r.  and  g(s.  =  c.  nlc.  ,  SN)  =  1-e.  Since  f  (x,  Is,  =  c,  _)  =  1  for  signals  in  added 
i  k  i ,  0  i ,  n  ’  i  k  k  i,  0  b 

white  Gaussian  noise,  Eq.  A.  34  becomes  for  s,  =  c,  „ 

k  i,  0 


Vk)  = 


Qi,o(k_1) 


Qin.ik-DjU-V 


(A.  35) 


BLANK  PAGE 
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The*  signal  can  only  reach  st£ t*  s  =  c.  .  from  s  =  c.  .  or  s  =  c  ,  and  the 

K  1*1  K”  1  l ,  u  K —  I  t ,  n j 

probabi  Hies  associated  with  these  transitions  are  g(s,  =  c,  .  Is,  .  =  c.  _ ,  SN)  =  v.  and 
1  k  t,  1  k- 1  0  i 

g's,  c.  ,1s,  ,  c  ,  SN)  =  v..  So  for  s,  =  c,  ,  ,Eq.  A.  34  can  be  written  as 
H  k  i,  1  k- 1  t,  n  l  k  i,  t 


i'k) ' 


V 


(k- 1)  *  Q,  ..  (k- 1)|  , f(xk I sk  »  c,  ,1 


i,  n 


'J 


'i.  1 


(A.  36) 


For  any  of  the  other  states,  c, 


be  reached  from  s,  ,  =  c.  ,  . 

k-1  l.J-l 


where  i  is  not  <*qual  to  0  or  1,  the  state  s,  =  c.  .  can  only 
J  k  i,  j 

The  probability  of  this  transition  is  one.  In  this  case 


Eq.  A.  34  becomes 


(A.  37) 


Now,  the  likel'hood  ratio  of  the  observation  X  was  given  by  Eq.  A.  32  a& 

K 


i,  n. 


f(X 


\ 


k'  -  -  Qs  <k) 

1=1  Vci,o  k 


(A.  32) 


Using  tile  notation  Q  (k) 


list:  itv/iauwii  v*  \  rv/  =  Q  .(k),  Eq.  A.  32  can  be  written  as 

Sk  '  Ci.  j  l’J 


HX„ 


b  nj 

\‘  v 

\~  1  j=o 


Q.  ((k) 
i.  J 


(A.  33) 


Equations  A.  35  through  A.  38  are  t.  e  ’lasic  equations  of  this  realization.  This  receiver  is 

much  simpler  than  the  previous  ones  if  o  le  compares  the  upaati  ig  equations  for  the  Q  ,(k) 

1 »  J 

matrix  witli  that  for  the  b,  (k)  matrix  of  Realization  I  in  Section  5.  1.  1,  one  sees  that  they  are 

i » J 

quite  similar  except  that  the  updating  of  b,  (k)  is  more  involved.  In  Realization  I,  each 

1 1 J 

b.  (k)  term  had  to  be  multiplied  b>  a  sequential  likelihood  ratio,  f(x  Is,  =  c  .),  to  obtain 
l,  j  k  k  l,  j 

the  likelihood  ratio,  f(X^),  of  the  observation  X^.  In  Reali.-aiton  IV,  however,  the  likelihood 

ratio  at  time  t^  is  simply  given  by  Eq.  A.  34.  In  order  to  see  how  a  classification  output  is 

obtained  from  the  Q  (k)  terms  let  us  first  look  at  another  interpretation  of  Q  ,(k).  We 
M  J  U  J 

know  from  Eq.  3.  8  that 


,V*'(Xk.i>‘Vxk-i> 


(3.  8) 
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By  definition 


f(\1Xk-,) 


4  \ 


l,  iij 

V 


'i,n. 


>,n. 

V 


1-1  V  ct,o  s2=c‘, o  Vci,o 


1  f(xk!sk)pk_1(s1,  s2, . . .  ,  skISN)  (A.  39) 


For  generator  processes  which  can  be  expressed  as  a  function,  p( s k I s k _ ^ ,  SN),  one  obtains, 
as  before,  for  the  average  sequential  likelihood  ratio 


c,  c. 

b  t,  n.  i,  n. 

£(xk'xk-i) ,(VV  -  . 

1-1  Sk  Ci,0  VrS.o 


g(sk!sk  l,SN)pk_1(sk  l!SN)  (A.  40) 


So  the  likelihood  ratio  of  the  observation  X  can  be  written  using  Eqs.  3.  8  and  5.  12  as 

K 


i,  n. 


c. 


i,  'I. 


f«x  )  -  iOC  )  1  1  «V»k>  1  B(sklsk-l'SN,|,k-1(sk-lIS,',) 

1=  1  s  =  c.  _  s.  c  A 

k  i,0  k- 1  i,0 


\ 


(A.  41) 


Since  (  j)  is  independent  of  the  summations  over  i,  sk  and  sk  j  one  can  bring  f(Xk  j) 
within  tlv  summation  signs  and  write  Fq.  A.  36  as 


f(X, 


b 

\ 


i,  n. 


i,  n. 


i=l  s.  c.  n 

k  i,0 


f(xk  sR) 


Vl  Ci,0 


K(sklsk-  r  SNI  (IXk-  l,pk-  1*  V 1 1 SKI 


(A.  12) 


Comparing  Eqs.  A.  37  and  A.  33  one  sees  that 

Q.  (k)  =  f(X.  )p  (s.  =  c,  ! SN)  (A.  43) 

l ,  J  K  K  K  1 ,  J 

Recalling  Eq,  6.  16 

bi,j(k)  Pk'\  Ci,  i,SN)  (5.  16) 

one  can  write  Eq.  A.  43  as 

Q.  ,(k)  =  f(X  )b,  t(k)  (A.  44) 

Q  (k)  may  be  interpreted  as  the  likelihood  ratio  of  the  observation  X,  multiplied  by  the 
1 1  J  k 

probabili.y  of  the  jth  component  sample  ol  the  ith  component,  under  the  condition  SN,  and  the 
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taking  of  k  observations. 


If  the  classification  output, 


b.  (k)  is  wanted, 
1  »  J 


it  can  be  determined  from 


t,  J 


Q  (k) 


TTx: 


(A.  45) 


If  the  updated  component  identification  is  desired,  it  can  be  derived  from 


p  (Cl  ISN)  =  ''  b.  (k)  = 
k  j=0  1>J 


n. 

t 

\ 

±c_ 


Vk) 


w 


(A.  46) 


The  operations  that  the  optimum  receiver  of  Realization  IV  performs  are  summarized  in 
Table  5.  3  in  Chapter  V  and  block  diagrams  are  presented  in  Figs.  5.  5  through  5.  8. 


APPENDIX  D 


OPTIMUM  ADAPTIVE  RECEIVER  REALIZATIONS, 
SYNCHRONOUS- POISSON  TIME  STRUCTURE 


B.  1  Realization  III 

In  Section  5.  2.  1  Realization  I  was  presented  for  the  Synchronous- Poisson  Time 
Structure.  Realization  III  is  a  "b"  channel  receiver.  In  this  realization  the  likelihood  ratio 
of  the  observation  may  be  written  as 

b  i  i 

f(X,  )  =  v  p  (C'lSN)  x  f(X.  Is)  p  tsic'.SN)  (B.  1) 

K  .  ,  O  '  K  U 

1=1  scS. 

i 

This  conditional  likelihood  ratio  is  to  be  realized  in  a  sequential  fashion  for  each  of  the  L 
possible  components,  so  that 

f  (Xkic')  f  (XR_  J  lc‘)f  (xk  I  XR_  J,  c‘)  (B.  2) 

In  the  Sy.ichronous-Poisson  Time  Structure,  the  component  conditional  sequential  likelihood 
ratio  has  been  previously  determined  and  is 

t(*k'xk.rc‘>=  '-VV<WCM>  '5-“' 

The  classification  output  is  obtained  from 

p  (c'lSN)f(X  ICl) 

Pk(ClSN)°  KXk)  ,l,3i 

The  design  equations  for  this  realization  are  summarized  in  Table  B.  1.  A  block  diagram  is 
shown  in  Fig.  B.  1  for  added  white  Gaussian  noise.  A  feature  of  this  realization  is  the  separate 
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Fig.  B.  1.  Adaptive  realization,  Synchronous -Poisson  Time  Structure, 

Realization  Ill 
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channel  allotted  for  each  of  the  h  components.  The  receiver  Input,  x^,  is  correlated  with 

each  possible  component  that  could  occur  and  the  bias  C  .  ■  C  ./ 2  is  subtracted.  These 

1,1  1,1 

outputs  are  then  passed  through  nonlinear  functions  which  depend  on  the  average  duty  factor 
of  each  component.  The  output  of  the  nonlinear  element  is  the  logarithm  of  the  component 
conditional  sequential  likelihood  ratio,  f(x^lX^  ^.C1).  These  values  are  summed  by  means 
of  the  recirculating  T^  delay  and  exponentiated  to  form  the  component  conditional  likelihood 
ratio,  i(X^ICl).  These  component  conditional  likelihood  ratios,  weighted  by  the  a  priori 
probabilities  of  the  possible  components,  are  summed  to  form  the  detection  output,  f(X  ). 

K 

The  classification  output  is  obtained  by  taking  the  output  of  each  channel  and  dividing  it  by 
the  detection  output,  f (X^ .  This  is  done  in  this  particular  realization  on  a  logarithmic  basis. 


TABLE  B.  1 

BASIC  RECEIVER  DESIGN  EQUATIONS,  SYNCHRONOUS- POISSON  TIME  STRUCTURE 

REALIZATION  III 


Optimum  Detection  Output 


b 

\ 


f(Xk)  =  N_  f(Xklc‘)p  (C*ISN) 
i- 1 


(A.  18) 


Component  Conditional  Likelihood  Ratio 


'(\,c)-'(xk-,lc>'(>.klxk.rc'l 


in.  21 


C o mponent  Conditional  Sequential  Likelihood  Ratio 


f(xkIXk-l,C)  =  ‘'‘I  *  'if(xkISk  Ci,l) 


(5.  60) 


Classification  -  Component  Identification 


p  (C  I SN)f(X  i C 
p(ClISN)=  -° 


in.  3) 
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B.  2  Realization  IV 

This  realization  is  somewhat  simpler  than  Realization  III  although  the  contrast  Is 
nut  so  great  as  in  the  sporadic  receiver.  Let  us  begin  the  derivation  of  this  realization  by 
considering  the  likelihood  ratio  of  the  observation  This  is 


„  Ci,l  Ci,i  Ci.  1 

‘<Xk-l’  "  -  _  f<Xk-lISl'S2 . Sk-l)po<Sl’S2 . Sk-1ISN' 

1=1  S.  =  C.  „  5,=C,  n  b.  ,=C.  n 
1  i,0  L  t,0  k-T  i,0 


(B.  4) 


Summing  with  respect  to  i  and  S^  ^last  one  obtains 


b 

\ 


'l,  1 

\ 


oxk.i>  ■  1 

1=1  Vrc,.o 


c.  ,  C.  , 

1,1  1, 1 


S2=Ci,0  Sk-2=Ci,0 


,(Xl;-lISrS2 . Sk-1^ 


1 

»„<srs2 . ViISN>j 

Uenoting  the  quantity  in  brackets  by  Qg  (k-1),  Eq.  B.  5  can  be  vrritten  as 

k- 1 


(B.  5) 


f  (X 


b 

\ 


ci.c 


k-r 


Qs  (k-l) 


1=1  Sk-fc:,o 


(  B.  6} 


Now,  the  likelihood  ratio  of  the  observation  is  by  definition 


c  ,  c.  .  c.  . 

b  1,1  1,1  1, 1 

nxj  1  1  v  ... 

1-1  s.=c  s,«c,  s,-c,  - 

1  1,0  2  i ,  0  k  t,0 


f(Xk_ ! IS!-  S2 . Sk.  f(xk’ VPo(Sl’  S2’ 


,SrISN) 


By  definition  of  a  joint  probability 


potsrs2 . skISN»-polsrs2 . VSNWS1'S2 . sk-rSN) 

(B.  8) 


But  in  the  Synchronous- Poisson  Time  Structure,  the  generator  process  is  such  that 


JL. 
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Po(Sk1Sr  32’ 


•  'Sk-rSN)  -  ^sk1SN') 


(B.  9) 


Substituting  Eq.  13.9  into  B  7  gives 


ci,l  c,.l  cu 

'°V  *  s  c  src  "s  c  ,1Xk-rSrS2 . Sk-lt((xkISk)po<SrS2’“  •Sk-l"=l5k!SN| 

1  i ,  0  2  i,0  k  i,0 

(B. 10) 


Interchanging  the  order  o!  summation  and  factoring,  Eq.  [3.  10  can  be  written  as 

r 


c. 


b 

\ 


i.  1 


C 


i.  1 


MXk)=:  1  f(X  !S  )  g(SklSN)< 

i=1  VCi,0 


Sk-rCi,G 


c.  .  c.  . 

1,1  1,1 


c 


■N 


1, 1 

\ 


.  r  ...  „  .  ‘Ixk-Ilsrs2 . Sk-i)|’o(si-S2 . Sk-1|SN) 

L  VS.O  VS.O  V2‘S.O 

(R.  11) 


But  the  multiple  sum  in  brackets  in  Eq.  B.  1 1  is  the  same  as  the  bracketed  term  in  Eq.  B.  5 

which  has  already  been  defined  as  Q„  (k-1).  Substituting  Q  (k-1)  into  Eq.  B.  11  gives 

k-1  k-1 


i,  1 


i  l 


l, 


f(X.  )  =  x  1  f  (x.  IS  )g(S  ISN)  N  Q  (k-1) 

i  1  S  =C.  n  S  C  Vl 

k  i,  0  k- 1  l,  0 


(B.  12) 


Now  Eq.  B.  6  can  be  written  with  the  subscript  k-1  advanced  to  k  resulting  in 


b 

\ 


i,  1 


MX,  )  '  1  Qc  (k) 

k  M  S,  C.  _  ak 
k  i,0 


(B.  13) 


Comparing  Eqs.  B.  12  and  B.  13  one  see1"  that 


i,  1 

(k)  r(x  is  )g(S  SN)  ^  Qc  (k-D 

X  sk-VCi.o  Vl 


(B  14) 
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Lit  us  us i'  tin  simpler  notations  Q,.  ( k)  Q  ( k)  and  Q  (k)  =  Q  (k) 

k  S,0  '-0  VS,1  '-1 

By  definition  of  the-  Synchronous- Poisson  generator  process  as  given  by  Kqs.  4.7  and  4.8 


g(Sk  SN)  1-e. 


for  S  C  . 

k  i,0 


J 4.  7) 


anil 


g(SkSN, 


for  S,  C 


(4  8) 


Therefore  Lq.  B.  14  can  be  written  as 


Q.  Qfk-1)  *  Q  ,1k- 1) 


(B.  15) 


a  nd 


Ql,l<kl  'V<VSk 


(B.  16) 


Instead  of  updating  Q,  „(k)  and  Q  (k)  separately,  one  ran  update  the  sum,  Q.(k)  =  Q.  (k) 

1  I  v  1  I  1  l  l  ,  V 

*  Q.  ,(k) 


Q,  ,(k)  Q.(k-l) 


1-V‘-|'(xk,Sk  =  C 


.,>] 


(3.  17) 


Using  the  notation  introtluced  above  for  the  Q„  (k)  Eq.  B.  13  can  be  written  as 


b  r 


f(XJ 


k  iTi 


Q,  0(k)  ♦  Q. 


i.  l(ki) 


(B.  18) 


or 


b 

f(X,  )  =  N  Q.(k) 
k  hi  1 


(B.  19) 


Equations  B.  P  and  B.  19  are  the  basic  equations  necessary  to  obtain  the  detection  output. 


The  interpretation  of  Q  (k)  is  similar  to  the  interpretation  given  of  Q,  (k)  in  the  sporadic  case 

i  *  i  J 


and  is 


Thus,  a  classification  output  is  easily  obtained.  The  design  equations  tor  this  receiver 
realization  are  summai'zed  in  Table  5.  5.  Block  diagrams  of  this  realization  are  shown  in 


Figs,  5.  5  through  5.  8. 


APPENDIX  C 


OPTIMUM  ADAPTIVE  RECEIVER  REALIZATIONS, 

P ERIODIC  TIME  STRUCTURE 

L.  1  Unknown  Repetition  Frequency,  Realization  II 

A  slight  modification  of  Realization  I,  presented  in  Section  5.  3.  1  may  be  obtained  by 

writing  the  joint  probability,  b  (k)  in  the  form  given  in  Eq.  A.  1,  o.  (k)  =  b'.  (k)p,  (C  !  SN), 

i ,  J  t ,  J  i .  J  k 

and  substituting  into  Eq.  5.  6G  for  the  sequential  average  likelihood  ratio.  Factoring  out 
Pk_  i<ci  1  SN>  Rives 


r(xklxk-i)  =  -  'Vi(ci|SN) 
1  =  1 


n. 

h  i.n  <k-1U<5k,sk  Ci,  1>  *  ',b  l.j-l(k-IKUk'Sk'Ci,]i 

I  J-  L 


(C.  1) 


Defining  a  component  conditional  sequential  likelihood  ratio,  f(x  [X  ,  C  )  as 

K  K”  1 

n. 

ll’ikIXk-rcl>  '  b  l.n.,k'l,,<xklsk  '  ci,  r  *  ,^2  -l(k-1'‘<V5k  c,.j>  (C-2» 


one  can  put  Eq.  C.  1  into  the  form 


,(kklxk-i»=5,  Vi,c,,sw“Nlxk-r  c'i> 

1=  1 


(C.  3) 


The  updating  equations  for  component  positional  information  are  obtained  by  making 

the  substitution  of  the  form  b  { k)  =  b\  ( kj  p.  ( C 1  [ SN)  in  both  sides  cl  Eqs.  5.68  and  5.69. 

I  *  J  l »  J  K 


The  result  is 


b,  j(k)p  (C'ISN)  = 


b  i,  n,(k_1)  Pk-l(C  ISX)f(xk‘Sk  =  Cl,  1} 


f(Xk|xk.i) 


(C.  4) 
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b\  'k)p,(ClSN)  = 

i,  j  k 


b'l.l-llk-||VlIC''SN'>%Uk  C|,i> 


'<\IXk-l! 


(C.  5) 


Instead  of  updating  the  products  of  t he  form  b'.  (k-l)p,  .(C'lSN),  one  can  update 

•  i  J  k  - 1 

b'j  ,_j(k-l)  and  p^  j(C'lSN)  separately  by  observing  that 


b  i,  l(k)  = 


b'.  (k-l)f(x.  Is.  -  c.  .) 

t,  n.  k  k  i,l 

l _ | _ 

"Wi1 


(C.  01 


b'.  .  ,(k-  1 ) f ( x.  Is.  c.  ) 
I,'.  (k)  ^  J^L 


i-  J 


'  lxk! Xk- 1* 


and 


(C.  7) 


for  j  2.3 . n 


Pk.1<C1,SNmxk|X  <■') 
p  (C  ISN)  =  -  - 


(C.  81 


The  design  equations  for  this  realization  are  summarized  in  Table  C.  1 


TABLE  C.  1 


BASIC  RECEIVER  DESIGN  EQUATIONS,  PERIODIC  TIME  STRUCTURE 
UNKNOWN  REPETITION  FREQUENCY 
REAL!  ZATION  II 


Optimum  Detection  Output 


“V '  "N-i 


(3  8' 


S cq uential  Average  Likelihood  Ratio 

f<xklxk-i>  '  ,  '>k-l,cl|SNI,(\l\-i'c'' 
i  1 


(C.  3) 
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Component  Conditional  Sequential  Likelihood  Ratio 


“kkIXk- 


C)  b'  (k-l)«xklak  ■  c 

I 


i=2 


bu.1(k-1)<(xk|Sk  cu)  (C.2) 


Class i ficatton  -  Component  Position 


b'.  ,(k) 

t.  1 


b-  (k-m(xklsk  =  ci  ,) 

t 


f(xkIxk-i) 


(C.  6) 


b\  (k) 

I,  J 


Classification  -  Component  Identification 


b'(.i-ilkl,(*klVci.i) 


(C.  7) 


for  j  2.3..  ,  n. 


Pk(C'iSN) 


Pk-|(CiISN)I(xkIXk_1,C1) 

f(xk,Xk-l) 


(C.  8) 


C.  2  Unknown  Repetition  Frequency,  Realization  III 

This  is  a  "b"  channel  realization  in  which  the  likelihood  ratio  of  the  entire  observe  • 
tion,  X  is  obtained  sequentially  under  the  condition  the  it h  component  is  present.  The 

K 

b  channels  are  then  weighted  by  the  a  priori  probability,  before  taking  any  observations,  of 
each  of  the  components.  The  detection  output  is 

b 

f(XR)  =  ^  f(Xk!C-;po(C‘lSN)  (A.  18) 

Each  channel  forms  'he  likelihood  ratio  of  the  observation,  X,  ,  conditional  to  the  Ith 

k 

component  and  this  is  formed  sequentially  as 

f(Xk!c‘)  =  f(Xk.1ICi)f(xkIXk_1,Cl)  (A  19) 


which  becomes  in  the  periodic  case 


l),i.nlk-1)%'Sk',:i,l)'  p  b'l,i-l(k-|)<(Xkl9k'C|.J)  <C'9) 

t  ]-  z 
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and  the  updating  equations  on  component  Identification  and  position  are  given  by  Eqs.  C.  6 
through  C.  8.  The  receiver  design  equations  for  this  realization  are  summarized  in  Table  C.  2 


TABLE  C.  2 

BASIC  RECEIVER  DESIGN  EQUATIONS,  PERIODIC  TIME  STRUCTURE 
UNKNOWN  REPETITION  FREQUENCY 
REALIZATION  III 


Optimum  Detection  Output 


b 

-■  N  f(X.  lc')p  (C'lSN 

K  ,  ■  |  K  O 


(A.  17) 


Component  Conditional  Likelihood  Ratio 


<VC>  ,'V-ilci»'l-Vxk.i'cl 


(A.  191 


Co mponent  Conditional  Sequential  Likelihood  Hati.) 


n. 


nXk1Xk-l'Cl)  b'i(n.(k-1)f(xk,Sk=Ci,l)  +  b'i,j-l(k-1)f(xklsk  '  Ci,  j’ 
i  J- 1- 


(C  9) 


C lassiflcation  -  Component  Position 


b'  tk-l)f(x.  Is,  -  c, 
i,  n.  k  k  i,l 

b  :  jOO  = - L - j - 

1  (xk!Xk-rC  ) 


b'i  ,-l(k'1)f(xklsk  :  ci  i} 
b'.  (k)  =  -  - - — - - 


i.  J 


1  lxk,xk-rc  1 


for  j  2,  3 . II 


Classification  -  Component  Identification 


Pk(ClISN)  - 


p  ( C 1 1 SN)f(X  ! C  ) 


f(X,, 


(C.  6) 


(C.  7! 


(C.  8) 
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C.  3  Unknown  Repetition  Frequency,  Realization  IV 

This  realization  is  the  least  adaptive  looking  of  the  realizations  but  it  is  the 

simplest.  It  is  a  "b  channel  receiver  and  its  development  follows  Appendix  A.  3  for  the 

sporadic  receiver  up  U  Eq.  A.  34  with  the  exception  that  the  summations  are  over  the  slates 

c  , ,  c.  . . c  rather  than  c  c.  ,,  c.  c  .  Analagous  to  Eq.  A.  31  one  can 

1,1  1,2  i,  n  t,  O'  i,  1  l.  2  i.  n. 

write 

c'.-, 

Qs  (k)  =  f (xRi sk)  ^  B(sklsk-r SN')  Qs  (k'!)  (c.  io) 

k  s.  ,=c.  ,  '  k- 1 

k- 1  t,l 

Using  the  properties  of  the  periodic  generator  process  given  by  Eqs.  4.  9  and  4.  10  in  Eq.  C.  10 
one  can  write 


Q.  ,(k)  =  Q  (tc-l)f(x.  Is. 

1,1  1 ,  1 1 .  K  K 


(C.  11) 


Qi.i(k)*Qi.j-i(k-,K(xk,8k=citj) 

(C.  12) 

for  j  2,  3, ...  ,  n. 

where  the  likelihood  ratio  of  the  observation  X,  is  given  by 

k 

.  n 

b  i 

f(X.  )  =  v  v  Q.  ,(k)  (C.  13) 

k  i=l  H  '•! 

Tin  classification  output  is  obtained  as  before  from  Eqs.  A.  44  and  A.  45.  The  basic  receiver 
design  equations  are  summarized  in  Table  5.7. 


APPENDIX  D 


COMPUTER  SIMULATION  TECHNIQUE 


The  receiver  realizations  discussed  in  Chapter  VII,  from  which  t he  HOC  data  was 
obtained,  were  simulated  on  l he  IBM  7090  digital  computer.  The  general  computational 
method  used  throughout  was  to  replace  all  continuous  random  variables  with  a  discrete 
random  variable.  A  50-point  discrete  probability  distribution  was  used  to  match  the  continu¬ 
ous  probability  distribution,  each  point  being  assigned  2  percent  probability.  That  is,  the 
two  probability  distribution  functions  were  matched  at  values  of  01,  03,.  ,  99.  This 

method  gives  a  rather  good  representation  of  the  random  variables  within  the  middle 
96  percent  of  the  range,  and  a  crude  representation  ol  the  smallest  2  percent  and  the 
largest  2  percent  of  the  range. 

The  optimum  adaptive  receiver  realization  discussed  in  Section  7.  2  for  one  of  eight 
orthogonal  components,  Synchronous- Poisson  Time  Structure,  was  simulated  on  the  digital 
computer.  The  digital  data  was  then  converted  to  analog  form  on  a  digital -to-analog  con¬ 
verter  and  plotted  out  on  a  Sanborn  pen  recorder. 
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APPENDIX  E 


DERIVATION  OF  PERFORMANCE  OF  ENERGY  DETECTOR , 
PERIODIC  AND  SYNCHRONOUS- POISSON  TIME  STRUCTURE 


In  this  section  the  detection  performance  of  the  energy  detector  is  derived  for  the 
CKS  (one  of  M  orthogonal  components).  Periodic  and  Synchronous  Time  Structures.  The 
detectability,  d,  can  be  expressed  as 


o 


(E.  1) 


where  r;  is  the  efficiency  (See  Reference  20).  Lamphiear  and  Birdsall  (Ref.  21)  have  shown 
that  the  efficiency  for  the  energy  detector  is  approximately 


when- 


( E.  2) 


n  2WT 


2 

c 


o 


2 

For  —  •  1, 

n 


(E.  3) 


and 


V 


1  * 


=  1  i  £_ 

2  n 


(E.  4) 
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1BC 


Using  these  approximations,  Fq.  E -2  becomes 


n  '  4  n  4  2WT 

For  the  Periodic  Time  Structure,  F  kF  and  T  kT,,  where  F 

c  1  c 

energy  and  is  the  duration  of  a  component.  Therefore,  Fq.  E-5  can  be 


’’  ''  4  2WT 

For  M  orthogonal  components  2WTj  is  at  least  \1.  Using  M  2WT  , 


ana  ; iie  detectability  as  defined  by  Icq.  F>1  becomes 


which  ts  Eq. 

I  o- 

number  of  i 


'  _  in  tiie  text 

ic  Synchr  >v  r  -  Poisson  Time  Structure,  and  the  occurrence 
poi.i"  s ,  _.  ckF!  and  the  efficiency  becomes 


and  d  becomes 


2E  , 

d  i]  .  k  -yp 
o 


(F.  5) 

is  the  component 
u  ritten  as 

(F.  6) 


(E.  7) 


(E.  8) 

of  th<  average 

(E.  9) 


(E.  10) 


which  is  Eq.  7.  15  in  the  text. 


APPENDIX  F 


DERIVATION  OF  PERFORMANCE,  SUBOPTIMUM  RECEIVER 
CKE,  SYNCHRONOUS- POISSON  TIME  STRUCTURE 


In  this  appendix  the  detection  performance  of  a  suboptimum  receiver  is  derived 
which  crosscorrelates  the  component,  C,  waveform  with  each  unit  observation,  Xj,  and 
integrates.  In  other  words,  the  receiver  forms 


k 

z  =  1’  x  C  (F.  1) 

U  1 


where  x.  is  an  n. -dimensional  observation  and  C  is  an  n. -dimensional  component.  This 
derivation  assumes  that  the-  detection  performance  is  the  same  as  that  had  the  average 
number  of  components  occurred. 

When  the  receiver  outputs  under  the  hypotheses  N  and  SN  are  normally  distributed, 
the  detectability,  d,  is  given  by  (Ref.  20) 


d  = 


~  >J  N,  k i 


N,  k 


(F.  2) 


where 


y  mean  of  the  receiver  output  conditional  to  SN  and  k  observations 

p^  mean  of  the  receiver  output  conditional  to  N  and  k  observations 

2 

o  ,  variance  of  the  receiver  output  conditional  to  N  and  k  observations 

N,  k 


Let  us  now  obtain  expressions  for  Pg^  p^  ^  and  a  ^  Since  the  sum  of  any 
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number  of  independent  normally  distiibuted  variables  is  itself  normally  distributed  with 
mean  the  sum  of  the  means  and  variance  the  sum  of  tin  variances,  then 


'SN.  k 


U-i  )k,. 


CN 


(  F.  3) 


where 


i  k  average  number  of  component  occurrences 

<\  -  i ■ ) k  average  number  of  no-component  occurrences 


CN 


"N 


mean  of  the  observation,  \  under  component  plus  noise 
mean  of  the  observation,  x.,  under  noise  alone 

i 


The  variance  under  noise  alone  after  k  observations  is  the  sum  of  the  variance  under  noise 
alone  ol  each  observation.  Thus 


2  ,  2 

a ,  ko 

.s ,  k  N 


(  F.  4) 


Substituting  Ftps.  F-3  and  F-4  into  the  definition  for  d,  Kq.  F-2,  results  m 

.  -2'-(  2 


(  F,  5) 


When  component  plus  noise  is  present  the  mean  of  thi  receiver  output  is  2WK  . 

When  noise  alone  is  present  tlu  mean  of  the  correlator  output  is  i.  0  and  the  variance 
is  2WK  N.  The  refore,  Kq.  F-S  becomes 


d 


2.  2Fc 

'  k  “ 

() 


(  F.  6) 


which  appears  a;  Kq.  7.  17. 
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